oceanbase4.2.2无法正常启动

OceanBase 技术问题
,
#1

【 使用环境 】测试环境
【 OB or 其他组件 】使用obd组件进行安装部署
【 使用版本 】4.2.2版本
【问题描述】清晰明确描述问题
测试环境,测试环境系统是centos7.x版本,安装单机版的oceanbase4.2.2,无法正常启动.
【复现路径】问题出现前后相关操作
【附件及日志】推荐使用OceanBase敏捷诊断工具obdiag收集诊断信息,详情参见链接（右键跳转查看）：

【SOP系列 22 】——故障诊断第一步(自助诊断和诊断信息收集)

====== 01.配置文件=========
ip和密码做了一些修改,应该不影响排查问题.

[root@centos7 xtocbase]# cat config.yaml
user:
username: root
password: m1xxxx@12#$
port: 22831
oceanbase-ce:
version: 4.2.4.0
release: 100000082024070810.el7
package_hash: 7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
143.50.97.36:
zone: zone1
servers:

  • 143.50.97.36
    global:
    appname: xtocbase
    root_password: TGB5tgb
    mysql_port: 2881
    rpc_port: 2882
    home_path: /data/xtocbase/oceanbase
    cluster_id: 1726110669
    enable_syslog_recycle: true
    enable_syslog_wf: false
    max_syslog_file_count: 4
    memory_limit: 30G
    datafile_size: 31872M
    system_memory: 12G
    log_disk_size: 147G
    cpu_count: 16
    datafile_maxsize: 167G
    datafile_next: 17069M
    ocp_agent_monitor_password: JOtyyJoQof
    proxyro_password: MaC2YZDsJq
    ocp_root_password: LpmaG0qKlO
    ocp_meta_password: THo1CGdHaR
    obproxy-ce:
    version: 4.2.3.0
    package_hash: 0490ebc04220def8d25cb9cac9ac61a4efa6d639
    release: 3.el7
    servers:
  • 143.50.97.36
    global:
    prometheus_listen_port: 2884
    listen_port: 2883
    home_path: /data/xtocbase/obproxy
    obproxy_sys_password: 5fBuzVR6fc
    skip_proxy_sys_private_check: true
    enable_strict_kernel_release: false
    enable_cluster_checkout: false
    rs_list: 143.50.97.36:2881
    cluster_name: xtocbase
    observer_root_password: TGB5tgb
    143.50.97.36:
    proxy_id: 5734
    client_session_id_version: 2
    depends:
  • oceanbase-ce
    obagent:
    version: 4.2.2
    package_hash: 19739a07a12eab736aff86ecf357b1ae660b554e
    release: 100000042024011120.el7
    servers:
  • 143.50.97.36
    global:
    monagent_http_port: 9088
    mgragent_http_port: 9089
    home_path: /data/xtocbase/obagent
    http_basic_auth_password: W95Mv7oUf
    ob_monitor_status: active
    depends:
  • oceanbase-ce
    ocp-express:
    version: 4.2.2
    package_hash: 09ffcf156d1df9318a78af52656f499d2315e3f7
    release: 100000022024011120.el7
    servers:
  • 143.50.97.36
    global:
    port: 9180
    home_path: /data/xtocbase/ocpexpress
    admin_passwd: (6k(FjM5
    ocp_root_password: 4#BkX6+l
    memory_size: 752M
    depends:
  • obagent
  • oceanbase-ce
  • obproxy-ce

=========02.执行过程内容=============
[root@centos7 xtocbase]# obd cluster start xtocbase --strict-check
Get local repositories ok
Search plugins ok
Load cluster param plugin ok
Open ssh connection ok
Check before start observer — Logging error —
Traceback (most recent call last):
File “logging/init.py”, line 1088, in emit
UnicodeEncodeError: ‘ascii’ codec can’t encode characters in position 121-129: ordinal not in range(128)
Call stack:
File “obd.py”, line 2278, in
File “obd.py”, line 310, in do_command
File “obd.py”, line 310, in do_command
File “obd.py”, line 246, in do_command
File “obd.py”, line 938, in _do_command
File “core.py”, line 2065, in start_cluster
File “core.py”, line 2144, in _start_cluster
File “core.py”, line 197, in call_plugin
File “_plugin.py”, line 348, in call
File “_plugin.py”, line 305, in _new_func
File “/root/.obd/plugins/oceanbase-ce/4.2.2.0/start_check.py”, line 266, in start_check
remote_pid = client.execute_command(‘cat %s’ % remote_pid_path).stdout.strip()
File “_plugin.py”, line 225, in new_method
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 503, in execute_command
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 475, in _execute_command
File “_stdio.py”, line 760, in verbose
File “_stdio.py”, line 717, in log
File “_stdio.py”, line 725, in _cache_log
File “_stdio.py”, line 737, in _log
File “logging/init.py”, line 1512, in log
File “log.py”, line 36, in _log
File “logging/init.py”, line 1589, in _log
File “logging/init.py”, line 1599, in handle
File “logging/init.py”, line 1661, in callHandlers
File “logging/init.py”, line 954, in handle
File “logging/handlers.py”, line 71, in emit
File “logging/init.py”, line 1187, in emit
File “logging/init.py”, line 1093, in emit
Message: ‘cat: /data/xtocbase/oceanbase/run/observer.pid: \u6ca1\u6709\u90a3\u4e2a\u6587\u4ef6\u6216\u76ee\u5f55’
Arguments: ()
Check before start observer ok
Check before start obproxy — Logging error —
Traceback (most recent call last):
File “logging/init.py”, line 1088, in emit
UnicodeEncodeError: ‘ascii’ codec can’t encode characters in position 77-80: ordinal not in range(128)
Call stack:
File “obd.py”, line 2278, in
File “obd.py”, line 310, in do_command
File “obd.py”, line 310, in do_command
File “obd.py”, line 246, in do_command
File “obd.py”, line 938, in _do_command
File “core.py”, line 2065, in start_cluster
File “core.py”, line 2144, in _start_cluster
File “core.py”, line 197, in call_plugin
File “_plugin.py”, line 348, in call
File “_plugin.py”, line 305, in _new_func
File “/root/.obd/plugins/obproxy-ce/4.2.3/start_check.py”, line 118, in start_check
if client.execute_command(‘ls /proc/%s/fd’ % remote_pid):
File “_plugin.py”, line 225, in new_method
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 503, in execute_command
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 475, in _execute_command
File “_stdio.py”, line 760, in verbose
File “_stdio.py”, line 717, in log
File “_stdio.py”, line 725, in _cache_log
File “_stdio.py”, line 737, in _log
File “logging/init.py”, line 1512, in log
File “log.py”, line 36, in _log
File “logging/init.py”, line 1589, in _log
File “logging/init.py”, line 1599, in handle
File “logging/init.py”, line 1661, in callHandlers
File “logging/init.py”, line 954, in handle
File “logging/handlers.py”, line 71, in emit
File “logging/init.py”, line 1187, in emit
File “logging/init.py”, line 1093, in emit
Message: ‘ls: \u65e0\u6cd5\u8bbf\u95ee/proc/4001/fd: \u6ca1\u6709\u90a3\u4e2a\u6587\u4ef6\u6216\u76ee\u5f55’
Arguments: ()
Check before start obproxy ok
Check before start obagent — Logging error —
Traceback (most recent call last):
File “logging/init.py”, line 1088, in emit
UnicodeEncodeError: ‘ascii’ codec can’t encode characters in position 120-128: ordinal not in range(128)
Call stack:
File “obd.py”, line 2278, in
File “obd.py”, line 310, in do_command
File “obd.py”, line 310, in do_command
File “obd.py”, line 246, in do_command
File “obd.py”, line 938, in _do_command
File “core.py”, line 2065, in start_cluster
File “core.py”, line 2144, in _start_cluster
File “core.py”, line 197, in call_plugin
File “_plugin.py”, line 348, in call
File “_plugin.py”, line 305, in _new_func
File “/root/.obd/plugins/obagent/1.3.0/start_check.py”, line 171, in start_check
remote_pid = client.execute_command(“cat %s” % remote_pid_path).stdout.strip()
File “_plugin.py”, line 225, in new_method
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 503, in execute_command
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 475, in _execute_command
File “_stdio.py”, line 760, in verbose
File “_stdio.py”, line 717, in log
File “_stdio.py”, line 725, in _cache_log
File “_stdio.py”, line 737, in _log
File “logging/init.py”, line 1512, in log
File “log.py”, line 36, in _log
File “logging/init.py”, line 1589, in _log
File “logging/init.py”, line 1599, in handle
File “logging/init.py”, line 1661, in callHandlers
File “logging/init.py”, line 954, in handle
File “logging/handlers.py”, line 71, in emit
File “logging/init.py”, line 1187, in emit
File “logging/init.py”, line 1093, in emit
Message: ‘cat: /data/xtocbase/obagent/run/ob_agentd.pid: \u6ca1\u6709\u90a3\u4e2a\u6587\u4ef6\u6216\u76ee\u5f55’
Arguments: ()
Check before start obagent ok
Check before start ocp-express — Logging error —
Traceback (most recent call last):
File “logging/init.py”, line 1088, in emit
UnicodeEncodeError: ‘ascii’ codec can’t encode characters in position 125-133: ordinal not in range(128)
Call stack:
File “obd.py”, line 2278, in
File “obd.py”, line 310, in do_command
File “obd.py”, line 310, in do_command
File “obd.py”, line 246, in do_command
File “obd.py”, line 938, in _do_command
File “core.py”, line 2065, in start_cluster
File “core.py”, line 2144, in _start_cluster
File “core.py”, line 197, in call_plugin
File “_plugin.py”, line 348, in call
File “_plugin.py”, line 305, in _new_func
File “/root/.obd/plugins/ocp-express/4.2.2/start_check.py”, line 345, in start_check
remote_pid = client.execute_command(‘cat %s’ % remote_pid_path).stdout.strip()
File “_plugin.py”, line 225, in new_method
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 503, in execute_command
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 475, in _execute_command
File “_stdio.py”, line 760, in verbose
File “_stdio.py”, line 717, in log
File “_stdio.py”, line 725, in _cache_log
File “_stdio.py”, line 737, in _log
File “logging/init.py”, line 1512, in log
File “log.py”, line 36, in _log
File “logging/init.py”, line 1589, in _log
File “logging/init.py”, line 1599, in handle
File “logging/init.py”, line 1661, in callHandlers
File “logging/init.py”, line 954, in handle
File “logging/handlers.py”, line 71, in emit
File “logging/init.py”, line 1187, in emit
File “logging/init.py”, line 1093, in emit
Message: ‘cat: /data/xtocbase/ocpexpress/run/ocp-express.pid: \u6ca1\u6709\u90a3\u4e2a\u6587\u4ef6\u6216\u76ee\u5f55’
Arguments: ()
Check before start ocp-express ok
Start observer — Logging error —
Traceback (most recent call last):
File “logging/init.py”, line 1088, in emit
UnicodeEncodeError: ‘ascii’ codec can’t encode characters in position 121-129: ordinal not in range(128)
Call stack:
File “obd.py”, line 2278, in
File “obd.py”, line 310, in do_command
File “obd.py”, line 310, in do_command
File “obd.py”, line 246, in do_command
File “obd.py”, line 938, in _do_command
File “core.py”, line 2065, in start_cluster
File “core.py”, line 2159, in _start_cluster
File “core.py”, line 197, in call_plugin
File “_plugin.py”, line 348, in call
File “_plugin.py”, line 305, in _new_func
File “/root/.obd/plugins/oceanbase-ce/4.2.2.0/start.py”, line 154, in start
remote_pid = client.execute_command(‘cat %s’ % remote_pid_path).stdout.strip()
File “_plugin.py”, line 225, in new_method
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 503, in execute_command
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 475, in _execute_command
File “_stdio.py”, line 760, in verbose
File “_stdio.py”, line 717, in log
File “_stdio.py”, line 725, in _cache_log
File “_stdio.py”, line 737, in _log
File “logging/init.py”, line 1512, in log
File “log.py”, line 36, in _log
File “logging/init.py”, line 1589, in _log
File “logging/init.py”, line 1599, in handle
File “logging/init.py”, line 1661, in callHandlers
File “logging/init.py”, line 954, in handle
File “logging/handlers.py”, line 71, in emit
File “logging/init.py”, line 1187, in emit
File “logging/init.py”, line 1093, in emit
Message: ‘cat: /data/xtocbase/oceanbase/run/observer.pid: \u6ca1\u6709\u90a3\u4e2a\u6587\u4ef6\u6216\u76ee\u5f55’
Arguments: ()
Start observer ok
— Logging error —
Traceback (most recent call last):
File “logging/init.py”, line 1088, in emit
UnicodeEncodeError: ‘ascii’ codec can’t encode characters in position 120-128: ordinal not in range(128)
Call stack:
File “obd.py”, line 2278, in
File “obd.py”, line 310, in do_command
File “obd.py”, line 310, in do_command
File “obd.py”, line 246, in do_command
File “obd.py”, line 938, in _do_command
File “core.py”, line 2065, in start_cluster
File “core.py”, line 2159, in _start_cluster
File “core.py”, line 197, in call_plugin
File “_plugin.py”, line 348, in call
File “_plugin.py”, line 305, in _new_func
File “/root/.obd/plugins/oceanbase-ce/4.2.2.0/start.py”, line 229, in start
obshell_pid = client.execute_command(‘cat %s’ % obshell_pid_path).stdout.strip()
File “_plugin.py”, line 225, in new_method
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 503, in execute_command
File “_stdio.py”, line 899, in func_wrapper
File “ssh.py”, line 475, in _execute_command
File “_stdio.py”, line 760, in verbose
File “_stdio.py”, line 717, in log
File “_stdio.py”, line 725, in _cache_log
File “_stdio.py”, line 737, in _log
File “logging/init.py”, line 1512, in log
File “log.py”, line 36, in _log
File “logging/init.py”, line 1589, in _log
File “logging/init.py”, line 1599, in handle
File “logging/init.py”, line 1661, in callHandlers
File “logging/init.py”, line 954, in handle
File “logging/handlers.py”, line 71, in emit
File “logging/init.py”, line 1187, in emit
File “logging/init.py”, line 1093, in emit
Message: ‘cat: /data/xtocbase/oceanbase/run/obshell.pid: \u6ca1\u6709\u90a3\u4e2a\u6587\u4ef6\u6216\u76ee\u5f55’
Arguments: ()
observer program health check ok
obshell program health check ok
Connect to observer x
[ERROR] OBD-1006: Failed to connect to oceanbase-ce
See https://www.oceanbase.com/product/ob-deployer/error-codes .
Trace ID: fa6c315e-a6f3-11ef-a823-00505682cd6e
If you want to view detailed obd logs, please run: obd display-trace fa6c315e-a6f3-11ef-a823-00505682cd6e

==============执行的截图内容===========

image
image1628×1608 179 KB

image
image1580×1204 173 KB

希望能给出解决方案啊.关键在于已经部署运行了好几周,有一天发现居然莫名其妙地oceanbase服务停了,然后就开始重启oceanbase,不断地重启和修改,都启动不成功.

1 个赞
#3

=======03.查看具体错误内容=========

[root@centos7 xtocbase]# obd display-trace fa6c315e-a6f3-11ef-a823-00505682cd6e
[2024-11-20 12:00:28.044] [DEBUG] - cmd: [‘xtocbase’]
[2024-11-20 12:00:28.044] [DEBUG] - opts: {‘servers’: None, ‘components’: None, ‘force_delete’: None, ‘strict_check’: True, ‘without_parameter’: None}
[2024-11-20 12:00:28.044] [DEBUG] - mkdir /root/.obd/lock/
[2024-11-20 12:00:28.044] [DEBUG] - unknown lock mode
[2024-11-20 12:00:28.045] [DEBUG] - try to get share lock /root/.obd/lock/global
[2024-11-20 12:00:28.045] [DEBUG] - share lock /root/.obd/lock/global, count 1
[2024-11-20 12:00:28.045] [DEBUG] - Get Deploy by name
[2024-11-20 12:00:28.045] [DEBUG] - mkdir /root/.obd/cluster/
[2024-11-20 12:00:28.045] [DEBUG] - mkdir /root/.obd/config_parser/
[2024-11-20 12:00:28.045] [DEBUG] - try to get exclusive lock /root/.obd/lock/deploy_xtocbase
[2024-11-20 12:00:28.045] [DEBUG] - exclusive lock /root/.obd/lock/deploy_xtocbase, count 1
[2024-11-20 12:00:28.051] [DEBUG] - Deploy status judge
[2024-11-20 12:00:28.052] [INFO] Get local repositories
[2024-11-20 12:00:28.052] [DEBUG] - mkdir /root/.obd/repository
[2024-11-20 12:00:28.053] [DEBUG] - Get local repository oceanbase-ce-4.2.4.0-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.053] [DEBUG] - Search repository oceanbase-ce version: 4.2.4.0, tag: 7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78, release: None, package_hash: None
[2024-11-20 12:00:28.053] [DEBUG] - try to get share lock /root/.obd/lock/mirror_and_repo
[2024-11-20 12:00:28.053] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 1
[2024-11-20 12:00:28.053] [DEBUG] - mkdir /root/.obd/repository/oceanbase-ce
[2024-11-20 12:00:28.055] [DEBUG] - Found repository oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.055] [DEBUG] - Get local repository obproxy-ce-4.2.3.0-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.055] [DEBUG] - Search repository obproxy-ce version: 4.2.3.0, tag: 0490ebc04220def8d25cb9cac9ac61a4efa6d639, release: None, package_hash: None
[2024-11-20 12:00:28.055] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 2
[2024-11-20 12:00:28.056] [DEBUG] - mkdir /root/.obd/repository/obproxy-ce
[2024-11-20 12:00:28.057] [DEBUG] - Found repository obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.057] [DEBUG] - Get local repository obagent-4.2.2-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:28.058] [DEBUG] - Search repository obagent version: 4.2.2, tag: 19739a07a12eab736aff86ecf357b1ae660b554e, release: None, package_hash: None
[2024-11-20 12:00:28.058] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 3
[2024-11-20 12:00:28.058] [DEBUG] - mkdir /root/.obd/repository/obagent
[2024-11-20 12:00:28.060] [DEBUG] - Found repository obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:28.060] [DEBUG] - Get local repository ocp-express-4.2.2-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:28.060] [DEBUG] - Search repository ocp-express version: 4.2.2, tag: 09ffcf156d1df9318a78af52656f499d2315e3f7, release: None, package_hash: None
[2024-11-20 12:00:28.060] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 4
[2024-11-20 12:00:28.060] [DEBUG] - mkdir /root/.obd/repository/ocp-express
[2024-11-20 12:00:28.062] [DEBUG] - Found repository ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:28.183] [DEBUG] - Get deploy config
[2024-11-20 12:00:28.212] [INFO] Search plugins
[2024-11-20 12:00:28.213] [DEBUG] - Searching start_check plugin for components …
[2024-11-20 12:00:28.213] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.213] [DEBUG] - mkdir /root/.obd/plugins
[2024-11-20 12:00:28.214] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.2.2.0 for oceanbase-ce-4.2.4.0
[2024-11-20 12:00:28.214] [DEBUG] - Searching start_check plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.215] [DEBUG] - Found for obproxy-ce-py_script_start_check-4.2.3 for obproxy-ce-4.2.3.0
[2024-11-20 12:00:28.215] [DEBUG] - Searching start_check plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:28.215] [DEBUG] - Found for obagent-py_script_start_check-1.3.0 for obagent-4.2.2
[2024-11-20 12:00:28.215] [DEBUG] - Searching start_check plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:28.215] [DEBUG] - Found for ocp-express-py_script_start_check-4.2.2 for ocp-express-4.2.2
[2024-11-20 12:00:28.215] [DEBUG] - Searching create_tenant plugin for components …
[2024-11-20 12:00:28.215] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.216] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.2.0.0 for oceanbase-ce-4.2.4.0
[2024-11-20 12:00:28.216] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.216] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.2.3.0
[2024-11-20 12:00:28.216] [DEBUG] - Searching create_tenant plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:28.216] [DEBUG] - No such create_tenant plugin for obagent-4.2.2
[2024-11-20 12:00:28.216] [DEBUG] - Searching create_tenant plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:28.216] [DEBUG] - No such create_tenant plugin for ocp-express-4.2.2
[2024-11-20 12:00:28.216] [DEBUG] - Searching tenant_optimize plugin for components …
[2024-11-20 12:00:28.216] [DEBUG] - Searching tenant_optimize plugin for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.217] [DEBUG] - No such tenant_optimize plugin for oceanbase-ce-4.2.4.0
[2024-11-20 12:00:28.217] [DEBUG] - Searching tenant_optimize plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.217] [DEBUG] - No such tenant_optimize plugin for obproxy-ce-4.2.3.0
[2024-11-20 12:00:28.217] [DEBUG] - Searching tenant_optimize plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:28.217] [DEBUG] - No such tenant_optimize plugin for obagent-4.2.2
[2024-11-20 12:00:28.217] [DEBUG] - Searching tenant_optimize plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:28.217] [DEBUG] - No such tenant_optimize plugin for ocp-express-4.2.2
[2024-11-20 12:00:28.217] [DEBUG] - Searching start plugin for components …
[2024-11-20 12:00:28.217] [DEBUG] - Searching start plugin for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.218] [DEBUG] - Found for oceanbase-ce-py_script_start-4.2.2.0 for oceanbase-ce-4.2.4.0
[2024-11-20 12:00:28.218] [DEBUG] - Searching start plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.218] [DEBUG] - Found for obproxy-ce-py_script_start-4.2.3 for obproxy-ce-4.2.3.0
[2024-11-20 12:00:28.218] [DEBUG] - Searching start plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:28.218] [DEBUG] - Found for obagent-py_script_start-1.3.0 for obagent-4.2.2
[2024-11-20 12:00:28.218] [DEBUG] - Searching start plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:28.219] [DEBUG] - Found for ocp-express-py_script_start-4.2.2 for ocp-express-4.2.2
[2024-11-20 12:00:28.219] [DEBUG] - Searching connect plugin for components …
[2024-11-20 12:00:28.219] [DEBUG] - Searching connect plugin for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.219] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.2.4.0
[2024-11-20 12:00:28.219] [DEBUG] - Searching connect plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.219] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.3.0
[2024-11-20 12:00:28.219] [DEBUG] - Searching connect plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:28.220] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-4.2.2
[2024-11-20 12:00:28.220] [DEBUG] - Searching connect plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:28.220] [DEBUG] - Found for ocp-express-py_script_connect-1.0.1 for ocp-express-4.2.2
[2024-11-20 12:00:28.220] [DEBUG] - Searching bootstrap plugin for components …
[2024-11-20 12:00:28.220] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.221] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.2.2.0 for oceanbase-ce-4.2.4.0
[2024-11-20 12:00:28.221] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.221] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.2.3.0
[2024-11-20 12:00:28.221] [DEBUG] - Searching bootstrap plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:28.221] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-4.2.2
[2024-11-20 12:00:28.221] [DEBUG] - Searching bootstrap plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:28.221] [DEBUG] - Found for ocp-express-py_script_bootstrap-1.0.1 for ocp-express-4.2.2
[2024-11-20 12:00:28.221] [DEBUG] - Searching display plugin for components …
[2024-11-20 12:00:28.221] [DEBUG] - Searching display plugin for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.222] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.4.0
[2024-11-20 12:00:28.222] [DEBUG] - Searching display plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.222] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.3.0
[2024-11-20 12:00:28.222] [DEBUG] - Searching display plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:28.222] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-4.2.2
[2024-11-20 12:00:28.222] [DEBUG] - Searching display plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:28.222] [DEBUG] - Found for ocp-express-py_script_display-1.0.1 for ocp-express-4.2.2
[2024-11-20 12:00:28.344] [INFO] Load cluster param plugin
[2024-11-20 12:00:28.345] [DEBUG] - Get local repository oceanbase-ce-4.2.4.0-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.345] [DEBUG] - Get local repository obproxy-ce-4.2.3.0-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.346] [DEBUG] - Get local repository obagent-4.2.2-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:28.346] [DEBUG] - Get local repository ocp-express-4.2.2-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:28.346] [DEBUG] - Searching param plugin for components …
[2024-11-20 12:00:28.346] [DEBUG] - Search param plugin for oceanbase-ce
[2024-11-20 12:00:28.347] [DEBUG] - Found for oceanbase-ce-param-4.2.2.0 for oceanbase-ce-4.2.4.0
[2024-11-20 12:00:28.347] [DEBUG] - Applying oceanbase-ce-param-4.2.2.0 for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:28.856] [DEBUG] - Search param plugin for obproxy-ce
[2024-11-20 12:00:28.857] [DEBUG] - Found for obproxy-ce-param-4.2.3 for obproxy-ce-4.2.3.0
[2024-11-20 12:00:28.857] [DEBUG] - Applying obproxy-ce-param-4.2.3 for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:28.975] [DEBUG] - Search param plugin for obagent
[2024-11-20 12:00:28.975] [DEBUG] - Found for obagent-param-1.3.0 for obagent-4.2.2
[2024-11-20 12:00:28.976] [DEBUG] - Applying obagent-param-1.3.0 for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:29.034] [DEBUG] - Search param plugin for ocp-express
[2024-11-20 12:00:29.034] [DEBUG] - Found for ocp-express-param-4.1.0 for ocp-express-4.2.2
[2024-11-20 12:00:29.034] [DEBUG] - Applying ocp-express-param-4.1.0 for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:29.157] [INFO] Open ssh connection
[2024-11-20 12:00:29.168] [DEBUG] - host: 143.50.97.36, port: 22831, user: root, password: Hedait@12#$
[2024-11-20 12:00:29.289] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.2.2.0 for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:29.289] [DEBUG] - import start_check
[2024-11-20 12:00:29.304] [DEBUG] - add start_check ref count to 1
[2024-11-20 12:00:29.304] [INFO] Check before start observer
[2024-11-20 12:00:29.306] [DEBUG] – root@143.50.97.36 execute: ls /data/xtocbase/oceanbase/store/clog/tenant_1/
[2024-11-20 12:00:29.324] [DEBUG] – exited code 0
[2024-11-20 12:00:29.325] [DEBUG] – root@143.50.97.36 execute: cat /data/xtocbase/oceanbase/run/observer.pid
[2024-11-20 12:00:29.381] [DEBUG] – exited code 1, error output:
[2024-11-20 12:00:29.382] [DEBUG]
[2024-11-20 12:00:29.382] [DEBUG] – 143.50.97.36 port check
[2024-11-20 12:00:29.382] [DEBUG] – root@143.50.97.36 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B41’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-11-20 12:00:29.447] [DEBUG] – exited code 0
[2024-11-20 12:00:29.447] [DEBUG] – root@143.50.97.36 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B42’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-11-20 12:00:29.516] [DEBUG] – exited code 0
[2024-11-20 12:00:29.517] [DEBUG] – root@143.50.97.36 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B46’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-11-20 12:00:29.590] [DEBUG] – exited code 0
[2024-11-20 12:00:29.591] [DEBUG] – root@143.50.97.36 execute: ls /data/xtocbase/oceanbase/store/sstable/block_file
[2024-11-20 12:00:29.652] [DEBUG] – exited code 0
[2024-11-20 12:00:29.653] [DEBUG] – root@143.50.97.36 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr
[2024-11-20 12:00:29.712] [DEBUG] – exited code 0
[2024-11-20 12:00:29.713] [DEBUG] – root@143.50.97.36 execute: ulimit -a
[2024-11-20 12:00:29.769] [DEBUG] – exited code 0
[2024-11-20 12:00:29.770] [DEBUG] – root@143.50.97.36 execute: sysctl -a
[2024-11-20 12:00:29.844] [DEBUG] – exited code 0
[2024-11-20 12:00:29.850] [DEBUG] – root@143.50.97.36 execute: cat /proc/meminfo
[2024-11-20 12:00:29.903] [DEBUG] – exited code 0
[2024-11-20 12:00:29.904] [DEBUG] – root@143.50.97.36 execute: df --block-size=1024
[2024-11-20 12:00:29.965] [DEBUG] – exited code 0
[2024-11-20 12:00:29.965] [DEBUG] – get disk info for path /, total: 205110317056 avail: 86566117376
[2024-11-20 12:00:29.965] [DEBUG] – get disk info for path /dev, total: 33682817024 avail: 33682817024
[2024-11-20 12:00:29.965] [DEBUG] – get disk info for path /dev/shm, total: 33693982720 avail: 33693982720
[2024-11-20 12:00:29.965] [DEBUG] – get disk info for path /run, total: 33693982720 avail: 33685082112
[2024-11-20 12:00:29.965] [DEBUG] – get disk info for path /sys/fs/cgroup, total: 33693982720 avail: 33693982720
[2024-11-20 12:00:29.965] [DEBUG] – get disk info for path /boot, total: 1063256064 avail: 918499328
[2024-11-20 12:00:29.966] [DEBUG] – get disk info for path /run/user/0, total: 6738796544 avail: 6738796544
[2024-11-20 12:00:29.966] [DEBUG] – disk: {’/’: {‘total’: 205110317056, ‘avail’: 86566117376, ‘need’: 0}, ‘/dev’: {‘total’: 33682817024, ‘avail’: 33682817024, ‘need’: 0}, ‘/dev/shm’: {‘total’: 33693982720, ‘avail’: 33693982720, ‘need’: 0}, ‘/run’: {‘total’: 33693982720, ‘avail’: 33685082112, ‘need’: 0}, ‘/sys/fs/cgroup’: {‘total’: 33693982720, ‘avail’: 33693982720, ‘need’: 0}, ‘/boot’: {‘total’: 1063256064, ‘avail’: 918499328, ‘need’: 0}, ‘/run/user/0’: {‘total’: 6738796544, ‘avail’: 6738796544, ‘need’: 0}}
[2024-11-20 12:00:29.966] [DEBUG] – root@143.50.97.36 execute: date +%s%N
[2024-11-20 12:00:30.025] [DEBUG] – exited code 0
[2024-11-20 12:00:30.026] [DEBUG] – 143.50.97.36 time delta -1.61376953125
[2024-11-20 12:00:30.090] [DEBUG] - sub start_check ref count to 0
[2024-11-20 12:00:30.091] [DEBUG] - export start_check
[2024-11-20 12:00:30.091] [DEBUG] - plugin oceanbase-ce-py_script_start_check-4.2.2.0 result: True
[2024-11-20 12:00:30.091] [DEBUG] - Call obproxy-ce-py_script_start_check-4.2.3 for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-11-20 12:00:30.091] [DEBUG] - import start_check
[2024-11-20 12:00:30.095] [DEBUG] - add start_check ref count to 1
[2024-11-20 12:00:30.096] [INFO] Check before start obproxy
[2024-11-20 12:00:30.098] [DEBUG] – root@143.50.97.36 execute: cat /data/xtocbase/obproxy/run/obproxy-143.50.97.36-2883.pid
[2024-11-20 12:00:30.115] [DEBUG] – exited code 0
[2024-11-20 12:00:30.115] [DEBUG] – root@143.50.97.36 execute: ls /proc/4001/fd
[2024-11-20 12:00:30.170] [DEBUG] – exited code 2, error output:
[2024-11-20 12:00:30.172] [DEBUG]
[2024-11-20 12:00:30.172] [DEBUG] – 143.50.97.36 port check
[2024-11-20 12:00:30.172] [DEBUG] – root@143.50.97.36 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B43’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-11-20 12:00:30.236] [DEBUG] – exited code 0
[2024-11-20 12:00:30.236] [DEBUG] – root@143.50.97.36 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B44’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-11-20 12:00:30.307] [DEBUG] – exited code 0
[2024-11-20 12:00:30.359] [DEBUG] - sub start_check ref count to 0
[2024-11-20 12:00:30.359] [DEBUG] - export start_check
[2024-11-20 12:00:30.359] [DEBUG] - plugin obproxy-ce-py_script_start_check-4.2.3 result: True
[2024-11-20 12:00:30.359] [DEBUG] - Call obagent-py_script_start_check-1.3.0 for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-11-20 12:00:30.360] [DEBUG] - import start_check
[2024-11-20 12:00:30.364] [DEBUG] - add start_check ref count to 1
[2024-11-20 12:00:30.365] [INFO] Check before start obagent
[2024-11-20 12:00:30.370] [DEBUG] – root@143.50.97.36 execute: cat /data/xtocbase/obagent/run/ob_agentd.pid
[2024-11-20 12:00:30.383] [DEBUG] – exited code 1, error output:
[2024-11-20 12:00:30.384] [DEBUG]
[2024-11-20 12:00:30.385] [DEBUG] – 143.50.97.36 port check
[2024-11-20 12:00:30.385] [DEBUG] – root@143.50.97.36 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:2381’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-11-20 12:00:30.452] [DEBUG] – exited code 0
[2024-11-20 12:00:30.453] [DEBUG] – root@143.50.97.36 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:2380’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-11-20 12:00:30.519] [DEBUG] – exited code 0
[2024-11-20 12:00:30.627] [DEBUG] - sub start_check ref count to 0
[2024-11-20 12:00:30.627] [DEBUG] - export start_check
[2024-11-20 12:00:30.627] [DEBUG] - plugin obagent-py_script_start_check-1.3.0 result: True
[2024-11-20 12:00:30.627] [DEBUG] - Call ocp-express-py_script_start_check-4.2.2 for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-11-20 12:00:30.627] [DEBUG] - import start_check
[2024-11-20 12:00:30.638] [DEBUG] - add start_check ref count to 1
[2024-11-20 12:00:30.639] [INFO] Check before start ocp-express
[2024-11-20 12:00:30.643] [DEBUG] – root@143.50.97.36 execute: cat /data/xtocbase/ocpexpress/run/ocp-express.pid
[2024-11-20 12:00:30.660] [DEBUG] – exited code 1, error output:
[2024-11-20 12:00:30.661] [DEBUG]
[2024-11-20 12:00:30.662] [DEBUG] – root@143.50.97.36 execute: bash -c ‘cat /proc/net/{udp*,tcp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:23DC’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-11-20 12:00:30.725] [DEBUG] – exited code 0
[2024-11-20 12:00:30.726] [DEBUG] – root@143.50.97.36 append ‘/data/xtocbase/ocpexpress/jre/bin:’ to PATH
[2024-11-20 12:00:30.726] [DEBUG] – root@143.50.97.36 execute: java -version
[2024-11-20 12:00:30.858] [DEBUG] – exited code 0
[2024-11-20 12:00:30.858] [DEBUG] – root@143.50.97.36 execute: cat /proc/meminfo
[2024-11-20 12:00:30.917] [DEBUG] – exited code 0
[2024-11-20 12:00:30.918] [DEBUG] – root@143.50.97.36 execute: df --block-size=1024
[2024-11-20 12:00:30.978] [DEBUG] – exited code 0
[2024-11-20 12:00:30.978] [DEBUG] – get disk info for path /, total: 205110317056 avail: 86566117376
[2024-11-20 12:00:30.978] [DEBUG] – get disk info for path /dev, total: 33682817024 avail: 33682817024
[2024-11-20 12:00:30.978] [DEBUG] – get disk info for path /dev/shm, total: 33693982720 avail: 33693982720
[2024-11-20 12:00:30.978] [DEBUG] – get disk info for path /run, total: 33693982720 avail: 33685082112
[2024-11-20 12:00:30.978] [DEBUG] – get disk info for path /sys/fs/cgroup, total: 33693982720 avail: 33693982720
[2024-11-20 12:00:30.978] [DEBUG] – get disk info for path /boot, total: 1063256064 avail: 918499328
[2024-11-20 12:00:30.978] [DEBUG] – get disk info for path /run/user/0, total: 6738796544 avail: 6738796544
[2024-11-20 12:00:30.978] [DEBUG] – root@143.50.97.36 execute: df --block-size=1024 /data/xtocbase/ocpexpress/log
[2024-11-20 12:00:31.040] [DEBUG] – exited code 0
[2024-11-20 12:00:31.040] [DEBUG] – get disk info for path /, total: 205110317056 avail: 86566117376
[2024-11-20 12:00:31.166] [DEBUG] - sub start_check ref count to 0
[2024-11-20 12:00:31.166] [DEBUG] - export start_check
[2024-11-20 12:00:31.166] [DEBUG] - plugin ocp-express-py_script_start_check-4.2.2 result: True
[2024-11-20 12:00:31.166] [DEBUG] - Call oceanbase-ce-py_script_start-4.2.2.0 for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:31.166] [DEBUG] - import start
[2024-11-20 12:00:31.172] [DEBUG] - add start ref count to 1
[2024-11-20 12:00:31.172] [INFO] Start observer
[2024-11-20 12:00:31.173] [DEBUG] – root@143.50.97.36 execute: ls /data/xtocbase/oceanbase/store/clog/tenant_1/
[2024-11-20 12:00:31.187] [DEBUG] – exited code 0
[2024-11-20 12:00:31.187] [DEBUG] – root@143.50.97.36 execute: cat /data/xtocbase/oceanbase/run/observer.pid
[2024-11-20 12:00:31.249] [DEBUG] – exited code 1, error output:
[2024-11-20 12:00:31.250] [DEBUG]
[2024-11-20 12:00:31.250] [DEBUG] – 143.50.97.36 start command construction
[2024-11-20 12:00:31.250] [DEBUG] – starting 143.50.97.36 observer
[2024-11-20 12:00:31.251] [DEBUG] – root@143.50.97.36 set env LD_LIBRARY_PATH to ‘/data/xtocbase/oceanbase/lib:’
[2024-11-20 12:00:31.251] [DEBUG] – root@143.50.97.36 execute: cd /data/xtocbase/oceanbase; /data/xtocbase/oceanbase/bin/observer -r ‘143.50.97.36:2882:2881’ -p 2881 -P 2882 -z ‘zone1’ -n ‘xtocbase’ -c 1726110669 -d ‘/data/xtocbase/oceanbase/store’ -I ‘143.50.97.36’ -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit=‘30G’,datafile_size=‘31872M’,system_memory=‘12G’,log_disk_size=‘147G’,cpu_count=16,datafile_maxsize=‘167G’,datafile_next=‘17069M’
[2024-11-20 12:00:31.363] [DEBUG] – exited code 0
[2024-11-20 12:00:31.364] [DEBUG] – root@143.50.97.36 delete env LD_LIBRARY_PATH
[2024-11-20 12:00:31.434] [DEBUG] – start_obshell: True
[2024-11-20 12:00:31.434] [DEBUG] – root@143.50.97.36 execute: cat /data/xtocbase/oceanbase/run/obshell.pid
[2024-11-20 12:00:31.457] [DEBUG] – exited code 1, error output:
[2024-11-20 12:00:31.460] [DEBUG]
[2024-11-20 12:00:31.460] [DEBUG] – root@143.50.97.36 set env OB_ROOT_PASSWORD to ‘‘TGB5tgb’’
[2024-11-20 12:00:31.460] [DEBUG] – start obshell: cd /data/xtocbase/oceanbase; /data/xtocbase/oceanbase/bin/obshell admin start --ip 143.50.97.36 --port 2886
[2024-11-20 12:00:31.461] [DEBUG] – root@143.50.97.36 execute: cd /data/xtocbase/oceanbase; /data/xtocbase/oceanbase/bin/obshell admin start --ip 143.50.97.36 --port 2886
[2024-11-20 12:00:33.583] [DEBUG] – exited code 0
[2024-11-20 12:00:33.584] [INFO] observer program health check
[2024-11-20 12:00:36.588] [DEBUG] – 143.50.97.36 program health check
[2024-11-20 12:00:36.589] [DEBUG] – root@143.50.97.36 execute: cat /data/xtocbase/oceanbase/run/observer.pid
[2024-11-20 12:00:36.612] [DEBUG] – exited code 0
[2024-11-20 12:00:36.613] [DEBUG] – root@143.50.97.36 execute: ls /proc/15363
[2024-11-20 12:00:36.670] [DEBUG] – exited code 0
[2024-11-20 12:00:36.670] [DEBUG] – 143.50.97.36 observer[pid: 15363] started
[2024-11-20 12:00:36.711] [INFO] obshell program health check
[2024-11-20 12:00:36.712] [DEBUG] – root@143.50.97.36 execute: cat /data/xtocbase/oceanbase/run/obshell.pid
[2024-11-20 12:00:36.729] [DEBUG] – exited code 0
[2024-11-20 12:00:36.730] [DEBUG] – root@143.50.97.36 execute: ls /proc/15453
[2024-11-20 12:00:36.796] [DEBUG] – exited code 0
[2024-11-20 12:00:36.796] [DEBUG] – 143.50.97.36 obshell[pid: 15453] started
[2024-11-20 12:00:36.843] [DEBUG] – need_bootstrap: False
[2024-11-20 12:00:36.843] [DEBUG] - sub start ref count to 0
[2024-11-20 12:00:36.843] [DEBUG] - export start
[2024-11-20 12:00:36.843] [DEBUG] - plugin oceanbase-ce-py_script_start-4.2.2.0 result: True
[2024-11-20 12:00:36.843] [DEBUG] - Call oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.2.4.0-100000082024070810.el7-7dc8b049b3283ef4660cdf6e3cfa24f81e9d2a78
[2024-11-20 12:00:36.844] [DEBUG] - import connect
[2024-11-20 12:00:36.945] [DEBUG] - add connect ref count to 1
[2024-11-20 12:00:36.945] [DEBUG] – connect obshell (143.50.97.36:2886)
[2024-11-20 12:00:36.946] [INFO] Connect to observer
[2024-11-20 12:00:36.946] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:00:39.950] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:00:42.954] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:04:40.270] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:04:43.274] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:04:46.278] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:04:49.282] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:04:52.286] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:04:55.290] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:04:58.294] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:05:01.298] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:05:04.302] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:05:07.307] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:05:10.311] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:05:13.315] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:05:16.319] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:05:19.323] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:05:22.327] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:05:25.332] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:05:28.336] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:05:31.340] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:05:34.344] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -p
[2024-11-20 12:05:37.348] [DEBUG] – connect 143.50.97.36 -P2881 -uroot -pTGB5tgb
[2024-11-20 12:05:37.351] [ERROR] Traceback (most recent call last):
[2024-11-20 12:05:37.351] [ERROR] File “pymysql/connections.py”, line 613, in connect
[2024-11-20 12:05:37.351] [ERROR] File “socket.py”, line 808, in create_connection
[2024-11-20 12:05:37.351] [ERROR] File “socket.py”, line 796, in create_connection
[2024-11-20 12:05:37.351] [ERROR] ConnectionRefusedError: [Errno 111] Connection refused
[2024-11-20 12:05:37.351] [ERROR]
[2024-11-20 12:05:37.351] [ERROR] During handling of the above exception, another exception occurred:
[2024-11-20 12:05:37.351] [ERROR]
[2024-11-20 12:05:37.352] [ERROR] Traceback (most recent call last):
[2024-11-20 12:05:37.352] [ERROR] File “core.py”, line 2065, in start_cluster
[2024-11-20 12:05:37.352] [ERROR] File “core.py”, line 2165, in _start_cluster
[2024-11-20 12:05:37.352] [ERROR] File “core.py”, line 197, in call_plugin
[2024-11-20 12:05:37.352] [ERROR] File “_plugin.py”, line 348, in call
[2024-11-20 12:05:37.352] [ERROR] File “_plugin.py”, line 305, in _new_func
[2024-11-20 12:05:37.352] [ERROR] File “/root/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 636, in connect
[2024-11-20 12:05:37.352] [ERROR] cursor = Cursor(ip=server.ip, port=server_config[‘mysql_port’], tenant=’’, password=password if password is not None else ‘’, stdio=stdio)
[2024-11-20 12:05:37.352] [ERROR] File “_stdio.py”, line 912, in wrapper
[2024-11-20 12:05:37.352] [ERROR] File “_stdio.py”, line 899, in func_wrapper
[2024-11-20 12:05:37.352] [ERROR] File “/root/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 528, in init
[2024-11-20 12:05:37.352] [ERROR] self._connect()
[2024-11-20 12:05:37.353] [ERROR] File “/root/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 558, in _connect
[2024-11-20 12:05:37.353] [ERROR] self.db = mysql.connect(host=self.ip, user=self.user, port=int(self.port), password=str(self.password),
[2024-11-20 12:05:37.353] [ERROR] File “pymysql/connections.py”, line 353, in init
[2024-11-20 12:05:37.353] [ERROR] File “pymysql/connections.py”, line 664, in connect
[2024-11-20 12:05:37.353] [ERROR] pymysql.err.OperationalError: (2003, “Can’t connect to MySQL server on ‘143.50.97.36’ ([Errno 111] Connection refused)”)
[2024-11-20 12:05:37.353] [ERROR]
[2024-11-20 12:05:40.424] [ERROR] OBD-1006: Failed to connect to oceanbase-ce
[2024-11-20 12:05:40.424] [DEBUG] - sub connect ref count to 0
[2024-11-20 12:05:40.424] [DEBUG] - export connect
[2024-11-20 12:05:40.424] [DEBUG] - plugin oceanbase-ce-py_script_connect-4.2.2.0 result: False
[2024-11-20 12:05:40.430] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes .
[2024-11-20 12:05:40.430] [INFO] Trace ID: fa6c315e-a6f3-11ef-a823-00505682cd6e
[2024-11-20 12:05:40.430] [INFO] If you want to view detailed obd logs, please run: obd display-trace fa6c315e-a6f3-11ef-a823-00505682cd6e
[2024-11-20 12:05:40.431] [DEBUG] - unlock /root/.obd/lock/global
[2024-11-20 12:05:40.431] [DEBUG] - unlock /root/.obd/lock/deploy_xtocbase
[2024-11-20 12:05:40.431] [DEBUG] - unlock /root/.obd/lock/mirror_and_repo

其中的内容应该是用户名和密码无法连接,但是我不配置文件就是这些内容.修改了若干次,都没有变化.

#4

observer.log (122.6 KB)

#5

1.麻烦看下yaml文件的编码格式，是否在windows上编辑过传上去的？file config.yaml

2.单独重启下observer 然后发下重启开始到结束的observer.log

/data/xtocbase/oceanbase/bin/observer -r ‘143.50.97.36:2882:2881’ -p 2881 -P 2882 -z ‘zone1’ -n ‘xtocbase’ -c 1726110669 -d ‘/data/xtocbase/oceanbase/store’ -I ‘143.50.97.36’ -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit=‘30G’,datafile_size=‘31872M’,system_memory=‘12G’,log_disk_size=‘147G’,cpu_count=16,datafile_maxsize=‘167G’,datafile_next=‘17069M’

2 个赞
#6

好复杂没看懂

#7

膜拜

#8

好的,非常感谢,我明天再试一试.这个是运维在弄的,我又用vim又重新敲了一遍.

#9

图片

查看了配置文件中/etc/profile和oceanbase的配置文件格式相同.

#10

图片
图片1920×444 97.3 KB

你好,这个是运维部署的.是不是根本就没有部署成功啊.我这个研发,接个二手的事情.

#11

将 OceanBase 数据库的 LIB 加到环境变量 LD_LIBRARY_PATH 中，按实际路径替换下面路径即可。

echo ‘export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:~/oceanbase-ce/lib/’ >> ~/.bash_profile
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:~/oceanbase-ce/lib/

然后再按照上面的命令单独重启下observer

#12

图片
图片884×498 57.5 KB

图片
图片1596×1444 299 KB

图片
图片1874×628 96.1 KB

就是一直连接不过去的.

#13

图片
图片1742×226 107 KB

#14

你这里的环境变量没有配置对

image
image1536×266 52.2 KB

#15

这个问题有进展了吗？

#16

图片
图片922×470 55.9 KB

修改了环境变量,然后重新启动.
图片
图片1694×538 85.4 KB

我又根据: OBD-2002：failed to start x.x.x.x observer调整了下内存,还是没法启动.

root@143.50.97.36 execute: cd /data/xtocbase/oceanbase; /data/xtocbase/oceanbase/bin/observer -r ‘143.50.97.36:2882:2881’ -p 2881 -P 2882 -z ‘zone1’ -n ‘xtocbase’ -c 1726110669 -d ‘/data/xtocbase/oceanbase/store’ -I ‘143.50.97.36’ -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit=‘20G’,datafile_size=‘31872M’,system_memory=‘8G’,log_disk_size=‘147G’,cpu_count=16,datafile_maxsize=‘167G’,datafile_next=‘17069M’

图片
图片1920×886 180 KB

#17

看日志应该是connect没有问题,但是就是没法启动.刚开始报内存不够,我修改为20G,调整另一个内存是8G,哎

#18

这个启动开始的observer.log发下吧