【 使用环境 】 测试环境
【 OB or 其他组件 】OB
【 使用版本 】4.2.2.1
【问题描述】断电后无法启动
【附件及日志】Check before start ocp-server ok
Start observer ok
observer program health check x
[WARN] OBD-2002: Failed to start 192.168.10.92 observer
[ERROR] oceanbase-ce start failed
内存有20G
[2024-06-24 20:12:46.729] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - cmd: [‘zlyob’]
[2024-06-24 20:12:46.729] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - opts: {‘servers’: None, ‘components’: None, ‘force_delete’: None, ‘strict_check’: None, ‘without_parameter’: None}
[2024-06-24 20:12:46.729] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - mkdir /root/.obd/lock/
[2024-06-24 20:12:46.730] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - unknown lock mode
[2024-06-24 20:12:46.730] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - try to get share lock /root/.obd/lock/global
[2024-06-24 20:12:46.730] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - share lock /root/.obd/lock/global, count 1
[2024-06-24 20:12:46.730] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Get Deploy by name
[2024-06-24 20:12:46.730] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - mkdir /root/.obd/cluster/
[2024-06-24 20:12:46.730] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - mkdir /root/.obd/config_parser/
[2024-06-24 20:12:46.730] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - try to get exclusive lock /root/.obd/lock/deploy_zlyob
[2024-06-24 20:12:46.730] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - exclusive lock /root/.obd/lock/deploy_zlyob, count 1
[2024-06-24 20:12:46.734] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Deploy status judge
[2024-06-24 20:12:46.734] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] Get local repositories
[2024-06-24 20:12:46.735] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - mkdir /root/.obd/repository
[2024-06-24 20:12:46.735] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Get local repository oceanbase-ce-4.2.2.1-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:46.735] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Search repository oceanbase-ce version: 4.2.2.1, tag: 3e30b9c0f183a5ef764ab754d5e517a671d96b38, release: None, package_hash: None
[2024-06-24 20:12:46.735] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - try to get share lock /root/.obd/lock/mirror_and_repo
[2024-06-24 20:12:46.735] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 1
[2024-06-24 20:12:46.735] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - mkdir /root/.obd/repository/oceanbase-ce
[2024-06-24 20:12:46.737] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found repository oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:46.737] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Get local repository obproxy-ce-4.2.3.0-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:46.737] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Search repository obproxy-ce version: 4.2.3.0, tag: 0490ebc04220def8d25cb9cac9ac61a4efa6d639, release: None, package_hash: None
[2024-06-24 20:12:46.737] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 2
[2024-06-24 20:12:46.737] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - mkdir /root/.obd/repository/obproxy-ce
[2024-06-24 20:12:46.738] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found repository obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:46.738] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Get local repository ocp-server-ce-4.2.2-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:46.738] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Search repository ocp-server-ce version: 4.2.2, tag: 84a65bf0ec004e73b772938696b2b896a0ef2b2f, release: None, package_hash: None
[2024-06-24 20:12:46.738] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 3
[2024-06-24 20:12:46.738] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - mkdir /root/.obd/repository/ocp-server-ce
[2024-06-24 20:12:46.740] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found repository ocp-server-ce-4.2.2-20240315150922.el7-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:46.871] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Get deploy config
[2024-06-24 20:12:46.890] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] Search plugins
[2024-06-24 20:12:46.890] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching start_check plugin for components …
[2024-06-24 20:12:46.890] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:46.890] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - mkdir /root/.obd/plugins
[2024-06-24 20:12:46.891] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.2.2.0 for oceanbase-ce-4.2.2.1
[2024-06-24 20:12:46.891] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching start_check plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:46.891] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.2.3.0
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching start_check plugin for ocp-server-ce-4.2.2-20240315150922.el7-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for ocp-server-ce-py_script_start_check-4.2.1 for ocp-server-ce-4.2.2
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching create_tenant plugin for components …
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.2.0.0 for oceanbase-ce-4.2.2.1
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.2.3.0
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching create_tenant plugin for ocp-server-ce-4.2.2-20240315150922.el7-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - No such create_tenant plugin for ocp-server-ce-4.2.2
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching start plugin for components …
[2024-06-24 20:12:46.892] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching start plugin for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:46.893] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for oceanbase-ce-py_script_start-4.2.2.0 for oceanbase-ce-4.2.2.1
[2024-06-24 20:12:46.893] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching start plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:46.893] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.2.3.0
[2024-06-24 20:12:46.893] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching start plugin for ocp-server-ce-4.2.2-20240315150922.el7-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:46.893] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for ocp-server-ce-py_script_start-4.2.1 for ocp-server-ce-4.2.2
[2024-06-24 20:12:46.893] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching connect plugin for components …
[2024-06-24 20:12:46.893] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching connect plugin for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:46.893] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.2.2.1
[2024-06-24 20:12:46.893] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching connect plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:46.893] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.3.0
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching connect plugin for ocp-server-ce-4.2.2-20240315150922.el7-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for ocp-server-ce-py_script_connect-4.2.1 for ocp-server-ce-4.2.2
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching bootstrap plugin for components …
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.2.2.0 for oceanbase-ce-4.2.2.1
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.2.3.0
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching bootstrap plugin for ocp-server-ce-4.2.2-20240315150922.el7-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for ocp-server-ce-py_script_bootstrap-4.2.1 for ocp-server-ce-4.2.2
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching display plugin for components …
[2024-06-24 20:12:46.894] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching display plugin for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:46.895] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.2.1
[2024-06-24 20:12:46.895] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching display plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:46.895] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.3.0
[2024-06-24 20:12:46.895] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching display plugin for ocp-server-ce-4.2.2-20240315150922.el7-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:46.895] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for ocp-server-ce-py_script_display-4.2.1 for ocp-server-ce-4.2.2
[2024-06-24 20:12:47.023] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] Load cluster param plugin
[2024-06-24 20:12:47.024] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Get local repository oceanbase-ce-4.2.2.1-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:47.024] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Get local repository obproxy-ce-4.2.3.0-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:47.024] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Get local repository ocp-server-ce-4.2.2-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:47.025] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Searching param plugin for components …
[2024-06-24 20:12:47.025] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Search param plugin for oceanbase-ce
[2024-06-24 20:12:47.026] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for oceanbase-ce-param-4.2.2.0 for oceanbase-ce-4.2.2.1
[2024-06-24 20:12:47.026] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Applying oceanbase-ce-param-4.2.2.0 for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:47.375] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Search param plugin for obproxy-ce
[2024-06-24 20:12:47.376] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.2.3.0
[2024-06-24 20:12:47.376] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:47.458] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Search param plugin for ocp-server-ce
[2024-06-24 20:12:47.458] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Found for ocp-server-ce-param-4.2.1 for ocp-server-ce-4.2.2
[2024-06-24 20:12:47.458] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Applying ocp-server-ce-param-4.2.1 for ocp-server-ce-4.2.2-20240315150922.el7-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:47.615] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] Open ssh connection
[2024-06-24 20:12:47.615] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - host: 192.168.10.91, port: 22, user: root, password: abc123456
[2024-06-24 20:12:47.752] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - host: 192.168.10.93, port: 22, user: root, password: abc123456
[2024-06-24 20:12:47.888] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - host: 192.168.10.92, port: 22, user: root, password: abc123456
[2024-06-24 20:12:48.023] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - host: 192.168.10.94, port: 22, user: root, password: abc123456
[2024-06-24 20:12:48.138] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.2.2.0 for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:48.138] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - import start_check
[2024-06-24 20:12:48.150] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - add start_check ref count to 1
[2024-06-24 20:12:48.150] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] Check before start observer
[2024-06-24 20:12:48.151] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: ls /data/1/clog/tenant_1/
[2024-06-24 20:12:48.203] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:48.204] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: cat /data/oceanbase/run/observer.pid
[2024-06-24 20:12:48.274] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 1, error output:
[2024-06-24 20:12:48.274] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] cat: /data/oceanbase/run/observer.pid: 没有那个文件或目录
[2024-06-24 20:12:48.274] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:48.274] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.91 port check
[2024-06-24 20:12:48.274] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: bash -c 'cat /proc/net/{tcp,udp}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B41’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:48.356] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:48.357] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: bash -c 'cat /proc/net/{tcp,udp}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B42’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:48.439] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:48.440] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B46’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:48.519] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:48.520] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: ls /data/1/sstable/block_file
[2024-06-24 20:12:48.593] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:48.596] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: cat /data/oceanbase/run/observer.pid
[2024-06-24 20:12:48.648] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 1, error output:
[2024-06-24 20:12:48.648] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] cat: /data/oceanbase/run/observer.pid: 没有那个文件或目录
[2024-06-24 20:12:48.648] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:48.648] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.92 port check
[2024-06-24 20:12:48.648] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B41’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:48.729] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:48.729] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B42’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:48.814] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:48.815] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B46’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:48.896] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:48.897] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: ls /data/1/sstable/block_file
[2024-06-24 20:12:48.971] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:48.972] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: cat /data/oceanbase/run/observer.pid
[2024-06-24 20:12:49.017] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 1, error output:
[2024-06-24 20:12:49.017] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] cat: /data/oceanbase/run/observer.pid: 没有那个文件或目录
[2024-06-24 20:12:49.017] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:49.017] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.93 port check
[2024-06-24 20:12:49.017] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B41’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:49.093] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.093] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B42’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:49.169] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.170] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B46’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:49.242] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.243] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: ls /data/1/sstable/block_file
[2024-06-24 20:12:49.313] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.314] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ]
[2024-06-24 20:12:49.382] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.383] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr
[2024-06-24 20:12:49.414] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.415] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: ulimit -a
[2024-06-24 20:12:49.483] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.484] [114d3e5e-3223-11ef-9385-000c29b6f727] [WARNING] OBD-1007: (192.168.10.91) The recommended number of core file size is unlimited (Current value: 0)
[2024-06-24 20:12:49.485] [114d3e5e-3223-11ef-9385-000c29b6f727] [WARNING] OBD-1007: (192.168.10.91) The recommended number of stack size is unlimited (Current value: 8192)
[2024-06-24 20:12:49.485] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: sysctl -a
[2024-06-24 20:12:49.592] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.601] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: cat /proc/meminfo
[2024-06-24 20:12:49.664] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.666] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: df --block-size=1024
[2024-06-24 20:12:49.747] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.749] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /, total: 53660876800 avail: 50532069376
[2024-06-24 20:12:49.749] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /dev, total: 10428358656 avail: 10428358656
[2024-06-24 20:12:49.749] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /dev/shm, total: 10440724480 avail: 10440724480
[2024-06-24 20:12:49.749] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /run, total: 10440724480 avail: 10431369216
[2024-06-24 20:12:49.749] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /sys/fs/cgroup, total: 10440724480 avail: 10440724480
[2024-06-24 20:12:49.750] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /boot, total: 1063256064 avail: 911294464
[2024-06-24 20:12:49.750] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /data, total: 1010285613056 avail: 8114044928
[2024-06-24 20:12:49.750] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /run/user/0, total: 2088144896 avail: 2088144896
[2024-06-24 20:12:49.750] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – disk: {’/’: {‘total’: 53660876800, ‘avail’: 50532069376, ‘need’: 0}, ‘/dev’: {‘total’: 10428358656, ‘avail’: 10428358656, ‘need’: 0}, ‘/dev/shm’: {‘total’: 10440724480, ‘avail’: 10440724480, ‘need’: 0}, ‘/run’: {‘total’: 10440724480, ‘avail’: 10431369216, ‘need’: 0}, ‘/sys/fs/cgroup’: {‘total’: 10440724480, ‘avail’: 10440724480, ‘need’: 0}, ‘/boot’: {‘total’: 1063256064, ‘avail’: 911294464, ‘need’: 0}, ‘/data’: {‘total’: 1010285613056, ‘avail’: 8114044928, ‘need’: 0}, ‘/run/user/0’: {‘total’: 2088144896, ‘avail’: 2088144896, ‘need’: 0}}
[2024-06-24 20:12:49.750] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ]
[2024-06-24 20:12:49.822] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.823] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr
[2024-06-24 20:12:49.860] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.861] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: ulimit -a
[2024-06-24 20:12:49.931] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:49.933] [114d3e5e-3223-11ef-9385-000c29b6f727] [WARNING] OBD-1007: (192.168.10.92) The recommended number of core file size is unlimited (Current value: 0)
[2024-06-24 20:12:49.933] [114d3e5e-3223-11ef-9385-000c29b6f727] [WARNING] OBD-1007: (192.168.10.92) The recommended number of stack size is unlimited (Current value: 8192)
[2024-06-24 20:12:49.933] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: sysctl -a
[2024-06-24 20:12:50.041] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.047] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: cat /proc/meminfo
[2024-06-24 20:12:50.114] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.115] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: df --block-size=1024
[2024-06-24 20:12:50.193] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.194] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /, total: 53660876800 avail: 51063078912
[2024-06-24 20:12:50.195] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /dev, total: 10428358656 avail: 10428358656
[2024-06-24 20:12:50.195] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /dev/shm, total: 10440724480 avail: 10440724480
[2024-06-24 20:12:50.195] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /run, total: 10440724480 avail: 10431369216
[2024-06-24 20:12:50.195] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /sys/fs/cgroup, total: 10440724480 avail: 10440724480
[2024-06-24 20:12:50.195] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /boot, total: 1063256064 avail: 911294464
[2024-06-24 20:12:50.195] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /data, total: 1010285613056 avail: 8240304128
[2024-06-24 20:12:50.195] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /run/user/0, total: 2088144896 avail: 2088144896
[2024-06-24 20:12:50.196] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – disk: {’/’: {‘total’: 53660876800, ‘avail’: 51063078912, ‘need’: 0}, ‘/dev’: {‘total’: 10428358656, ‘avail’: 10428358656, ‘need’: 0}, ‘/dev/shm’: {‘total’: 10440724480, ‘avail’: 10440724480, ‘need’: 0}, ‘/run’: {‘total’: 10440724480, ‘avail’: 10431369216, ‘need’: 0}, ‘/sys/fs/cgroup’: {‘total’: 10440724480, ‘avail’: 10440724480, ‘need’: 0}, ‘/boot’: {‘total’: 1063256064, ‘avail’: 911294464, ‘need’: 0}, ‘/data’: {‘total’: 1010285613056, ‘avail’: 8240304128, ‘need’: 0}, ‘/run/user/0’: {‘total’: 2088144896, ‘avail’: 2088144896, ‘need’: 0}}
[2024-06-24 20:12:50.196] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ]
[2024-06-24 20:12:50.265] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.266] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr
[2024-06-24 20:12:50.300] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.300] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: ulimit -a
[2024-06-24 20:12:50.371] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.372] [114d3e5e-3223-11ef-9385-000c29b6f727] [WARNING] OBD-1007: (192.168.10.93) The recommended number of core file size is unlimited (Current value: 0)
[2024-06-24 20:12:50.372] [114d3e5e-3223-11ef-9385-000c29b6f727] [WARNING] OBD-1007: (192.168.10.93) The recommended number of stack size is unlimited (Current value: 8192)
[2024-06-24 20:12:50.372] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: sysctl -a
[2024-06-24 20:12:50.467] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.474] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: cat /proc/meminfo
[2024-06-24 20:12:50.534] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.535] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: df --block-size=1024
[2024-06-24 20:12:50.609] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.610] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /, total: 53660876800 avail: 50992062464
[2024-06-24 20:12:50.610] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /dev, total: 10428358656 avail: 10428358656
[2024-06-24 20:12:50.610] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /dev/shm, total: 10440724480 avail: 10440724480
[2024-06-24 20:12:50.610] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /run, total: 10440724480 avail: 10431373312
[2024-06-24 20:12:50.611] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /sys/fs/cgroup, total: 10440724480 avail: 10440724480
[2024-06-24 20:12:50.611] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /boot, total: 1063256064 avail: 911290368
[2024-06-24 20:12:50.611] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /data, total: 1033701330944 avail: 31213744128
[2024-06-24 20:12:50.611] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /run/user/0, total: 2088144896 avail: 2088144896
[2024-06-24 20:12:50.611] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – disk: {’/’: {‘total’: 53660876800, ‘avail’: 50992062464, ‘need’: 0}, ‘/dev’: {‘total’: 10428358656, ‘avail’: 10428358656, ‘need’: 0}, ‘/dev/shm’: {‘total’: 10440724480, ‘avail’: 10440724480, ‘need’: 0}, ‘/run’: {‘total’: 10440724480, ‘avail’: 10431373312, ‘need’: 0}, ‘/sys/fs/cgroup’: {‘total’: 10440724480, ‘avail’: 10440724480, ‘need’: 0}, ‘/boot’: {‘total’: 1063256064, ‘avail’: 911290368, ‘need’: 0}, ‘/data’: {‘total’: 1033701330944, ‘avail’: 31213744128, ‘need’: 0}, ‘/run/user/0’: {‘total’: 2088144896, ‘avail’: 2088144896, ‘need’: 0}}
[2024-06-24 20:12:50.612] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: date +%s%N
[2024-06-24 20:12:50.646] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.647] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.91 time delta -28476763.396728516
[2024-06-24 20:12:50.647] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: date +%s%N
[2024-06-24 20:12:50.681] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.682] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.92 time delta -28476762.81201172
[2024-06-24 20:12:50.682] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: date +%s%N
[2024-06-24 20:12:50.715] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.716] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.93 time delta -28476763.56201172
[2024-06-24 20:12:50.761] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] e[33m[WARN]e[39m OBD-1007: (192.168.10.91) The recommended number of core file size is unlimited (Current value: 0)
[2024-06-24 20:12:50.761] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] e[33m[WARN]e[39m OBD-1007: (192.168.10.91) The recommended number of stack size is unlimited (Current value: 8192)
[2024-06-24 20:12:50.761] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] e[33m[WARN]e[39m OBD-1007: (192.168.10.92) The recommended number of core file size is unlimited (Current value: 0)
[2024-06-24 20:12:50.761] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] e[33m[WARN]e[39m OBD-1007: (192.168.10.92) The recommended number of stack size is unlimited (Current value: 8192)
[2024-06-24 20:12:50.761] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] e[33m[WARN]e[39m OBD-1007: (192.168.10.93) The recommended number of core file size is unlimited (Current value: 0)
[2024-06-24 20:12:50.761] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] e[33m[WARN]e[39m OBD-1007: (192.168.10.93) The recommended number of stack size is unlimited (Current value: 8192)
[2024-06-24 20:12:50.761] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO]
[2024-06-24 20:12:50.762] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - sub start_check ref count to 0
[2024-06-24 20:12:50.762] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - export start_check
[2024-06-24 20:12:50.762] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-06-24 20:12:50.762] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - import start_check
[2024-06-24 20:12:50.766] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - add start_check ref count to 1
[2024-06-24 20:12:50.767] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] Check before start obproxy
[2024-06-24 20:12:50.767] [114d3e5e-3223-11ef-9385-000c29b6f727] [WARNING] OBD-4521: The config observer_sys_password in obproxy-ce did not take effect, please config it in oceanbase-ce
[2024-06-24 20:12:50.767] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: cat /data/obproxy/run/obproxy-192.168.10.94-2883.pid
[2024-06-24 20:12:50.780] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.780] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: ls /proc/25155/fd
[2024-06-24 20:12:50.833] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 2, error output:
[2024-06-24 20:12:50.833] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] ls: 无法访问/proc/25155/fd: 没有那个文件或目录
[2024-06-24 20:12:50.833] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:50.834] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.94 port check
[2024-06-24 20:12:50.834] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B43’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:50.890] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:50.891] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B44’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:50.944] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.030] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] e[33m[WARN]e[39m OBD-4521: The config observer_sys_password in obproxy-ce did not take effect, please config it in oceanbase-ce
[2024-06-24 20:12:51.030] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO]
[2024-06-24 20:12:51.030] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - sub start_check ref count to 0
[2024-06-24 20:12:51.030] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - export start_check
[2024-06-24 20:12:51.030] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Call ocp-server-ce-py_script_start_check-4.2.1 for ocp-server-ce-4.2.2-20240315150922.el7-84a65bf0ec004e73b772938696b2b896a0ef2b2f
[2024-06-24 20:12:51.030] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - import start_check
[2024-06-24 20:12:51.038] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - add start_check ref count to 1
[2024-06-24 20:12:51.039] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] Check before start ocp-server
[2024-06-24 20:12:51.041] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – oceanbase version check
[2024-06-24 20:12:51.041] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: sudo -n true
[2024-06-24 20:12:51.061] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.061] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: cat /data/ocp/run/ocp-server.pid
[2024-06-24 20:12:51.112] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.113] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: ls /proc/28117
[2024-06-24 20:12:51.165] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 2, error output:
[2024-06-24 20:12:51.165] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] ls: 无法访问/proc/28117: 没有那个文件或目录
[2024-06-24 20:12:51.165] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:51.165] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – user check
[2024-06-24 20:12:51.165] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – port check
[2024-06-24 20:12:51.165] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: bash -c ‘cat /proc/net/{udp*,tcp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:1F90’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-06-24 20:12:51.221] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.221] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – java check
[2024-06-24 20:12:51.222] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: java -version
[2024-06-24 20:12:51.316] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.317] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – java version <ssh.SshReturn object at 0x7ff07c087d30>
[2024-06-24 20:12:51.317] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – java_major_version 1.8.0
[2024-06-24 20:12:51.317] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – java_update_version 402
[2024-06-24 20:12:51.317] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – clockdiff check
[2024-06-24 20:12:51.317] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: which clockdiff
[2024-06-24 20:12:51.378] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.378] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – memory check
[2024-06-24 20:12:51.379] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: cat /proc/meminfo
[2024-06-24 20:12:51.440] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.441] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – disk check
[2024-06-24 20:12:51.442] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: df --block-size=1024
[2024-06-24 20:12:51.495] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.495] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /, total: 53660876800 avail: 49333927936
[2024-06-24 20:12:51.496] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /dev, total: 10429292544 avail: 10429292544
[2024-06-24 20:12:51.496] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /dev/shm, total: 10441658368 avail: 10441658368
[2024-06-24 20:12:51.496] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /run, total: 10441658368 avail: 10432360448
[2024-06-24 20:12:51.496] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /sys/fs/cgroup, total: 10441658368 avail: 10441658368
[2024-06-24 20:12:51.496] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /boot, total: 1063256064 avail: 911294464
[2024-06-24 20:12:51.496] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /data, total: 473414701056 avail: 427251527680
[2024-06-24 20:12:51.496] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /run/user/0, total: 2088333312 avail: 2088333312
[2024-06-24 20:12:51.496] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.94 execute: df --block-size=1024 /data/logs
[2024-06-24 20:12:51.557] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.557] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – get disk info for path /data, total: 473414701056 avail: 427251527680
[2024-06-24 20:12:51.565] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - sub start_check ref count to 0
[2024-06-24 20:12:51.565] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - export start_check
[2024-06-24 20:12:51.565] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - Call oceanbase-ce-py_script_start-4.2.2.0 for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-06-24 20:12:51.565] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - import start
[2024-06-24 20:12:51.572] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - add start ref count to 1
[2024-06-24 20:12:51.573] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] Start observer
[2024-06-24 20:12:51.574] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: ls /data/1/clog/tenant_1/
[2024-06-24 20:12:51.610] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.610] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: cat /data/oceanbase/run/observer.pid
[2024-06-24 20:12:51.683] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 1, error output:
[2024-06-24 20:12:51.684] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] cat: /data/oceanbase/run/observer.pid: 没有那个文件或目录
[2024-06-24 20:12:51.684] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:51.684] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.91 start command construction
[2024-06-24 20:12:51.684] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: ls /data/1/clog/tenant_1/
[2024-06-24 20:12:51.724] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.725] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: cat /data/oceanbase/run/observer.pid
[2024-06-24 20:12:51.797] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 1, error output:
[2024-06-24 20:12:51.797] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] cat: /data/oceanbase/run/observer.pid: 没有那个文件或目录
[2024-06-24 20:12:51.798] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:51.798] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.92 start command construction
[2024-06-24 20:12:51.798] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: ls /data/1/clog/tenant_1/
[2024-06-24 20:12:51.836] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:51.837] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: cat /data/oceanbase/run/observer.pid
[2024-06-24 20:12:51.909] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 1, error output:
[2024-06-24 20:12:51.910] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] cat: /data/oceanbase/run/observer.pid: 没有那个文件或目录
[2024-06-24 20:12:51.910] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:51.910] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.93 start command construction
[2024-06-24 20:12:51.911] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – starting 192.168.10.91 observer
[2024-06-24 20:12:51.911] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 set env LD_LIBRARY_PATH to ‘/data/oceanbase/lib:’
[2024-06-24 20:12:51.912] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: cd /data/oceanbase; /data/oceanbase/bin/observer -r ‘192.168.10.91:2882:2881;192.168.10.92:2882:2881;192.168.10.93:2882:2881’ -p 2881 -P 2882 -z ‘ob1’ -n ‘zlyob’ -c 1710988434 -d ‘/data/1’ -I ‘192.168.10.91’ -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit=‘16G’,datafile_size=‘892G’,system_memory=‘5G’,log_disk_size=‘40G’,cpu_count=18
[2024-06-24 20:12:52.016] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:52.017] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 delete env LD_LIBRARY_PATH
[2024-06-24 20:12:52.017] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – starting 192.168.10.92 observer
[2024-06-24 20:12:52.017] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 set env LD_LIBRARY_PATH to ‘/data/oceanbase/lib:’
[2024-06-24 20:12:52.017] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: cd /data/oceanbase; /data/oceanbase/bin/observer -r ‘192.168.10.91:2882:2881;192.168.10.92:2882:2881;192.168.10.93:2882:2881’ -p 2881 -P 2882 -z ‘ob2’ -n ‘zlyob’ -c 1710988434 -d ‘/data/1’ -I ‘192.168.10.92’ -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit=‘16G’,datafile_size=‘892G’,system_memory=‘5G’,log_disk_size=‘40G’,cpu_count=18
[2024-06-24 20:12:52.100] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:52.100] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 delete env LD_LIBRARY_PATH
[2024-06-24 20:12:52.100] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – starting 192.168.10.93 observer
[2024-06-24 20:12:52.101] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 set env LD_LIBRARY_PATH to ‘/data/oceanbase/lib:’
[2024-06-24 20:12:52.101] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: cd /data/oceanbase; /data/oceanbase/bin/observer -r ‘192.168.10.91:2882:2881;192.168.10.92:2882:2881;192.168.10.93:2882:2881’ -p 2881 -P 2882 -z ‘ob3’ -n ‘zlyob’ -c 1710988434 -d ‘/data/1’ -I ‘192.168.10.93’ -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit=‘16G’,datafile_size=‘892G’,system_memory=‘5G’,log_disk_size=‘40G’,cpu_count=18
[2024-06-24 20:12:52.196] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:52.197] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 delete env LD_LIBRARY_PATH
[2024-06-24 20:12:52.229] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – start_obshell: True
[2024-06-24 20:12:52.230] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: cat /data/oceanbase/run/obshell.pid
[2024-06-24 20:12:52.260] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 1, error output:
[2024-06-24 20:12:52.260] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] cat: /data/oceanbase/run/obshell.pid: 没有那个文件或目录
[2024-06-24 20:12:52.260] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:52.261] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 set env OB_ROOT_PASSWORD to ‘’**aaAA11’’
[2024-06-24 20:12:52.262] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – start obshell: cd /data/oceanbase; /data/oceanbase/bin/obshell admin start --ip 192.168.10.91 --port 2886
[2024-06-24 20:12:52.262] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: cd /data/oceanbase; /data/oceanbase/bin/obshell admin start --ip 192.168.10.91 --port 2886
[2024-06-24 20:12:54.413] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:54.413] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: cat /data/oceanbase/run/obshell.pid
[2024-06-24 20:12:54.450] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 1, error output:
[2024-06-24 20:12:54.450] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] cat: /data/oceanbase/run/obshell.pid: 没有那个文件或目录
[2024-06-24 20:12:54.451] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:54.451] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 set env OB_ROOT_PASSWORD to ‘’**aaAA11’’
[2024-06-24 20:12:54.451] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – start obshell: cd /data/oceanbase; /data/oceanbase/bin/obshell admin start --ip 192.168.10.92 --port 2886
[2024-06-24 20:12:54.451] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: cd /data/oceanbase; /data/oceanbase/bin/obshell admin start --ip 192.168.10.92 --port 2886
[2024-06-24 20:12:56.602] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:56.602] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: cat /data/oceanbase/run/obshell.pid
[2024-06-24 20:12:56.634] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:56.635] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: ls /proc/16979
[2024-06-24 20:12:56.710] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 2, error output:
[2024-06-24 20:12:56.710] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] ls: 无法访问/proc/16979: 没有那个文件或目录
[2024-06-24 20:12:56.710] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:12:56.710] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 set env OB_ROOT_PASSWORD to ‘’**aaAA11’’
[2024-06-24 20:12:56.710] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – start obshell: cd /data/oceanbase; /data/oceanbase/bin/obshell admin start --ip 192.168.10.93 --port 2886
[2024-06-24 20:12:56.710] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: cd /data/oceanbase; /data/oceanbase/bin/obshell admin start --ip 192.168.10.93 --port 2886
[2024-06-24 20:12:58.852] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:12:58.853] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] observer program health check
[2024-06-24 20:13:01.857] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.91 program health check
[2024-06-24 20:13:01.858] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: cat /data/oceanbase/run/observer.pid
[2024-06-24 20:13:01.889] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:13:01.890] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.91 execute: ls /proc/16270
[2024-06-24 20:13:01.966] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:13:01.967] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.91 observer[pid: 16270] started
[2024-06-24 20:13:01.967] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.92 program health check
[2024-06-24 20:13:01.967] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.92 execute: cat /data/oceanbase/run/observer.pid
[2024-06-24 20:13:02.005] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 1, error output:
[2024-06-24 20:13:02.006] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] cat: /data/oceanbase/run/observer.pid: 没有那个文件或目录
[2024-06-24 20:13:02.006] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG]
[2024-06-24 20:13:02.006] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.93 program health check
[2024-06-24 20:13:02.006] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: cat /data/oceanbase/run/observer.pid
[2024-06-24 20:13:02.043] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:13:02.044] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – root@192.168.10.93 execute: ls /proc/18782
[2024-06-24 20:13:02.116] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – exited code 0
[2024-06-24 20:13:02.116] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] – 192.168.10.93 observer[pid: 18782] started
[2024-06-24 20:13:02.247] [114d3e5e-3223-11ef-9385-000c29b6f727] [WARNING] OBD-2002: Failed to start 192.168.10.92 observer
[2024-06-24 20:13:02.247] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - sub start ref count to 0
[2024-06-24 20:13:02.247] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - export start
[2024-06-24 20:13:02.248] [114d3e5e-3223-11ef-9385-000c29b6f727] [ERROR] oceanbase-ce start failed
[2024-06-24 20:13:02.253] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] See OceanBase分布式数据库-海量数据 笔笔算数 .
[2024-06-24 20:13:02.253] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] Trace ID: 114d3e5e-3223-11ef-9385-000c29b6f727
[2024-06-24 20:13:02.254] [114d3e5e-3223-11ef-9385-000c29b6f727] [INFO] If you want to view detailed obd logs, please run: obd display-trace 114d3e5e-3223-11ef-9385-000c29b6f727
[2024-06-24 20:13:02.254] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 2
[2024-06-24 20:13:02.254] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 1
[2024-06-24 20:13:02.255] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 0
[2024-06-24 20:13:02.255] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - unlock /root/.obd/lock/mirror_and_repo
[2024-06-24 20:13:02.255] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - exclusive lock /root/.obd/lock/deploy_zlyob release, count 0
[2024-06-24 20:13:02.255] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - unlock /root/.obd/lock/deploy_zlyob
[2024-06-24 20:13:02.255] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - share lock /root/.obd/lock/global release, count 0
[2024-06-24 20:13:02.255] [114d3e5e-3223-11ef-9385-000c29b6f727] [DEBUG] - unlock /root/.obd/lock/global
麻烦提供下完整的obd日志（~/.obd/log/obd）