【 OB or 其他组件 】
【 使用版本 】 V4.3.5_BP1_HF1
【问题描述】执行obd cluster start obtest后有个health_check报错
【复现路径】单机部署
【日志】
[root@cjx observer]# obd display-trace 5e981b62-2745-11f0-9459-000c29212bbb
[2025-05-02 19:05:34.174] [DEBUG] - cmd: [‘obtest’]
[2025-05-02 19:05:34.174] [DEBUG] - opts: {‘servers’: None, ‘components’: None, ‘force_delete’: None, ‘strict_check’: None, ‘without_parameter’: None}
[2025-05-02 19:05:34.174] [DEBUG] - mkdir /root/.obd/lock/
[2025-05-02 19:05:34.174] [DEBUG] - unknown lock mode
[2025-05-02 19:05:34.175] [DEBUG] - try to get share lock /root/.obd/lock/global
[2025-05-02 19:05:34.175] [DEBUG] - share lock /root/.obd/lock/global, count 1
[2025-05-02 19:05:34.175] [DEBUG] - Get Deploy by name
[2025-05-02 19:05:34.176] [DEBUG] - mkdir /root/.obd/cluster/
[2025-05-02 19:05:34.176] [DEBUG] - mkdir /root/.obd/config_parser/
[2025-05-02 19:05:34.176] [DEBUG] - try to get exclusive lock /root/.obd/lock/deploy_obtest
[2025-05-02 19:05:34.176] [DEBUG] - exclusive lock /root/.obd/lock/deploy_obtest, count 1
[2025-05-02 19:05:34.180] [DEBUG] - Deploy status judge
[2025-05-02 19:05:34.180] [INFO] Get local repositories
[2025-05-02 19:05:34.181] [DEBUG] - mkdir /root/.obd/repository
[2025-05-02 19:05:34.181] [DEBUG] - Get local repository oceanbase-ce-4.3.5.1-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:34.181] [DEBUG] - Search repository oceanbase-ce version: 4.3.5.1, tag: f4041930aada05b85182f5134cd7f3d3f5cf5f70, release: None, package_hash: None
[2025-05-02 19:05:34.181] [DEBUG] - try to get share lock /root/.obd/lock/mirror_and_repo
[2025-05-02 19:05:34.182] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 1
[2025-05-02 19:05:34.182] [DEBUG] - mkdir /root/.obd/repository/oceanbase-ce
[2025-05-02 19:05:34.183] [DEBUG] - Found repository oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:34.312] [DEBUG] - Get deploy config
[2025-05-02 19:05:34.321] [INFO] Load cluster param plugin
[2025-05-02 19:05:34.321] [DEBUG] - Get local repository oceanbase-ce-4.3.5.1-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:34.322] [DEBUG] - Searching param plugin for components …
[2025-05-02 19:05:34.322] [DEBUG] - Search param plugin for oceanbase-ce
[2025-05-02 19:05:34.322] [DEBUG] - mkdir /root/.obd/plugins
[2025-05-02 19:05:34.323] [DEBUG] - Found for oceanbase-ce-param-4.3.3.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:05:34.323] [DEBUG] - Applying oceanbase-ce-param-4.3.3.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:34.745] [INFO] Open ssh connection
[2025-05-02 19:05:34.749] [DEBUG] - host: 192.168.153.66, port: 22, user: root, password: ******
[2025-05-02 19:05:40.226] [DEBUG] - Searching start_check template for components …
[2025-05-02 19:05:40.227] [DEBUG] - mkdir /root/.obd/workflows
[2025-05-02 19:05:40.228] [DEBUG] - Call workflow oceanbase-ce-py_script_workflow_start_check-4.3.0.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:40.228] [DEBUG] - mkdir /root/.obd/mirror
[2025-05-02 19:05:40.228] [DEBUG] - mkdir /root/.obd/mirror/remote
[2025-05-02 19:05:40.228] [DEBUG] - mkdir /root/.obd/mirror/local
[2025-05-02 19:05:40.228] [DEBUG] - mkdir /root/.obd/optimize/
[2025-05-02 19:05:40.228] [DEBUG] - mkdir /root/.obd/tool/
[2025-05-02 19:05:40.229] [DEBUG] - import start_check
[2025-05-02 19:05:40.229] [DEBUG] - add start_check ref count to 1
[2025-05-02 19:05:40.229] [DEBUG] - sub start_check ref count to 0
[2025-05-02 19:05:40.229] [DEBUG] - export start_check
[2025-05-02 19:05:40.229] [DEBUG] - plugin oceanbase-ce-py_script_workflow_start_check-4.3.0.0 result: True
[2025-05-02 19:05:40.229] [DEBUG] - Found for oceanbase-ce-py_script_workflow_start_check-4.3.0.0 for oceanbase-ce-4.3.0.0
[2025-05-02 19:05:40.230] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 2
[2025-05-02 19:05:40.231] [DEBUG] - Searching start_check_pre plugin for components …
[2025-05-02 19:05:40.232] [DEBUG] - Searching start_check_pre plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:40.232] [DEBUG] - Found for oceanbase-ce-py_script_start_check_pre-4.3.0.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:05:40.232] [DEBUG] - Call plugin oceanbase-ce-py_script_start_check_pre-4.3.0.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:40.232] [DEBUG] - import start_check_pre
[2025-05-02 19:05:40.233] [DEBUG] - add start_check_pre ref count to 1
[2025-05-02 19:05:40.234] [DEBUG] - sub start_check_pre ref count to 0
[2025-05-02 19:05:40.234] [DEBUG] - export start_check_pre
[2025-05-02 19:05:40.234] [DEBUG] - plugin oceanbase-ce-py_script_start_check_pre-4.3.0.0 result: True
[2025-05-02 19:05:40.234] [DEBUG] - Searching status_check plugin for components …
[2025-05-02 19:05:40.234] [DEBUG] - Searching status_check plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:40.235] [DEBUG] - Found for oceanbase-ce-py_script_status_check-4.2.1.4 for oceanbase-ce-4.3.5.1
[2025-05-02 19:05:40.235] [DEBUG] - Call plugin oceanbase-ce-py_script_status_check-4.2.1.4 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:40.235] [DEBUG] - import status_check
[2025-05-02 19:05:40.235] [DEBUG] - add status_check ref count to 1
[2025-05-02 19:05:40.236] [DEBUG] – root@192.168.153.66 execute: ls /data/1/clog/tenant_1/
[2025-05-02 19:05:50.956] [DEBUG] – exited code 2, error output:
[2025-05-02 19:05:50.956] [DEBUG] ls: cannot access /data/1/clog/tenant_1/: No such file or directory
[2025-05-02 19:05:50.956] [DEBUG]
[2025-05-02 19:05:50.956] [DEBUG] – root@192.168.153.66 execute: cat /root/observer/run/observer.pid
[2025-05-02 19:05:51.195] [DEBUG] – exited code 0
[2025-05-02 19:05:51.195] [DEBUG] – root@192.168.153.66 execute: ls /proc/14811
[2025-05-02 19:05:51.432] [DEBUG] – exited code 2, error output:
[2025-05-02 19:05:51.432] [DEBUG] ls: cannot access /proc/14811: No such file or directory
[2025-05-02 19:05:51.432] [DEBUG]
[2025-05-02 19:05:51.432] [DEBUG] - sub status_check ref count to 0
[2025-05-02 19:05:51.432] [DEBUG] - export status_check
[2025-05-02 19:05:51.433] [DEBUG] - plugin oceanbase-ce-py_script_status_check-4.2.1.4 result: True
[2025-05-02 19:05:51.433] [DEBUG] - Searching parameter_check plugin for components …
[2025-05-02 19:05:51.433] [DEBUG] - Searching parameter_check plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:51.433] [DEBUG] - Found for oceanbase-ce-py_script_parameter_check-4.0.0.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:05:51.433] [DEBUG] - Call plugin oceanbase-ce-py_script_parameter_check-4.0.0.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:51.433] [DEBUG] - import parameter_check
[2025-05-02 19:05:51.434] [DEBUG] - add parameter_check ref count to 1
[2025-05-02 19:05:51.435] [DEBUG] – root@192.168.153.66 execute: ls /data/1/sstable/block_file
[2025-05-02 19:05:51.672] [DEBUG] – exited code 2, error output:
[2025-05-02 19:05:51.672] [DEBUG] ls: cannot access /data/1/sstable/block_file: No such file or directory
[2025-05-02 19:05:51.672] [DEBUG]
[2025-05-02 19:05:51.673] [DEBUG] - sub parameter_check ref count to 0
[2025-05-02 19:05:51.673] [DEBUG] - export parameter_check
[2025-05-02 19:05:51.673] [DEBUG] - plugin oceanbase-ce-py_script_parameter_check-4.0.0.0 result: True
[2025-05-02 19:05:51.673] [DEBUG] - Searching system_limits_check plugin for components …
[2025-05-02 19:05:51.673] [DEBUG] - Searching system_limits_check plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:51.673] [DEBUG] - Found for oceanbase-ce-py_script_system_limits_check-3.1.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:05:51.673] [DEBUG] - Call plugin oceanbase-ce-py_script_system_limits_check-3.1.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:05:51.673] [DEBUG] - import system_limits_check
[2025-05-02 19:05:51.675] [DEBUG] - add system_limits_check ref count to 1
[2025-05-02 19:05:51.675] [DEBUG] – root@192.168.153.66 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr
[2025-05-02 19:05:57.098] [DEBUG] – exited code 0
[2025-05-02 19:05:57.098] [DEBUG] – root@192.168.153.66 execute: bash -c “ulimit -a”
[2025-05-02 19:05:57.339] [DEBUG] – exited code 0
[2025-05-02 19:05:57.339] [DEBUG] – root@192.168.153.66 execute: sysctl -a
[2025-05-02 19:06:02.789] [DEBUG] – exited code 0
[2025-05-02 19:06:02.790] [DEBUG] - sub system_limits_check ref count to 0
[2025-05-02 19:06:02.790] [DEBUG] - export system_limits_check
[2025-05-02 19:06:02.790] [DEBUG] - plugin oceanbase-ce-py_script_system_limits_check-3.1.0 result: True
[2025-05-02 19:06:02.791] [DEBUG] - Searching resource_check plugin for components …
[2025-05-02 19:06:02.791] [DEBUG] - Searching resource_check plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:06:02.791] [DEBUG] - Found for oceanbase-ce-py_script_resource_check-4.0.0.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:06:02.791] [DEBUG] - Call plugin oceanbase-ce-py_script_resource_check-4.0.0.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:06:02.791] [DEBUG] - import resource_check
[2025-05-02 19:06:02.793] [DEBUG] - add resource_check ref count to 1
[2025-05-02 19:06:02.794] [DEBUG] – root@192.168.153.66 execute: cat /proc/meminfo
[2025-05-02 19:06:08.228] [DEBUG] – exited code 0
[2025-05-02 19:06:08.228] [WARNING] OBD-2010: (192.168.153.66): system_memory too large. system_memory should be less than 0.75 * memory_limit/memory_limit_percentage.
[2025-05-02 19:06:08.229] [DEBUG] – root@192.168.153.66 execute: df --block-size=1024
[2025-05-02 19:06:13.615] [DEBUG] – exited code 0
[2025-05-02 19:06:13.616] [DEBUG] – get disk info for path /dev, total: 6253379584 avail: 6253379584
[2025-05-02 19:06:13.616] [DEBUG] – get disk info for path /dev/shm, total: 6270869504 avail: 6270869504
[2025-05-02 19:06:13.616] [DEBUG] – get disk info for path /run, total: 6270869504 avail: 6257823744
[2025-05-02 19:06:13.616] [DEBUG] – get disk info for path /sys/fs/cgroup, total: 6270869504 avail: 6270869504
[2025-05-02 19:06:13.616] [DEBUG] – get disk info for path /, total: 53660876800 avail: 26436136960
[2025-05-02 19:06:13.616] [DEBUG] – get disk info for path /mnt/iso, total: 4746297344 avail: 0
[2025-05-02 19:06:13.616] [DEBUG] – get disk info for path /boot, total: 1063256064 avail: 867590144
[2025-05-02 19:06:13.616] [DEBUG] – get disk info for path /home, total: 136286052352 avail: 136252157952
[2025-05-02 19:06:13.616] [DEBUG] – get disk info for path /run/user/42, total: 1254174720 avail: 1254162432
[2025-05-02 19:06:13.616] [DEBUG] – get disk info for path /run/user/0, total: 1254174720 avail: 1254174720
[2025-05-02 19:06:13.616] [DEBUG] – root@192.168.153.66 execute: df --block-size=1024 /data/1
[2025-05-02 19:06:24.205] [DEBUG] – exited code 0
[2025-05-02 19:06:24.205] [DEBUG] – get disk info for path /, total: 53660876800 avail: 26436136960
[2025-05-02 19:06:24.205] [DEBUG] – root@192.168.153.66 execute: df --block-size=1024 /data/log1/clog
[2025-05-02 19:06:34.819] [DEBUG] – exited code 0
[2025-05-02 19:06:34.820] [DEBUG] – get disk info for path /, total: 53660876800 avail: 26436136960
[2025-05-02 19:06:34.820] [DEBUG] – disk: {’/dev’: {‘total’: 6253379584, ‘avail’: 6253379584, ‘need’: 0}, ‘/dev/shm’: {‘total’: 6270869504, ‘avail’: 6270869504, ‘need’: 0}, ‘/run’: {‘total’: 6270869504, ‘avail’: 6257823744, ‘need’: 0}, ‘/sys/fs/cgroup’: {‘total’: 6270869504, ‘avail’: 6270869504, ‘need’: 0}, ‘/’: {‘total’: 53660876800, ‘avail’: 26436136960, ‘need’: 0}, ‘/mnt/iso’: {‘total’: 4746297344, ‘avail’: 0, ‘need’: 0}, ‘/boot’: {‘total’: 1063256064, ‘avail’: 867590144, ‘need’: 0}, ‘/home’: {‘total’: 136286052352, ‘avail’: 136252157952, ‘need’: 0}, ‘/run/user/42’: {‘total’: 1254174720, ‘avail’: 1254162432, ‘need’: 0}, ‘/run/user/0’: {‘total’: 1254174720, ‘avail’: 1254174720, ‘need’: 0}}
[2025-05-02 19:06:34.820] [WARNING] OBD-1012: (192.168.153.66) clog and data use the same disk (/)
[2025-05-02 19:06:34.820] [DEBUG] – root@192.168.153.66 execute: date +%s%N
[2025-05-02 19:06:35.053] [DEBUG] – exited code 0
[2025-05-02 19:06:35.053] [DEBUG] – 192.168.153.66 time delta 115.0341796875
[2025-05-02 19:06:35.053] [DEBUG] - sub resource_check ref count to 0
[2025-05-02 19:06:35.053] [DEBUG] - export resource_check
[2025-05-02 19:06:35.053] [DEBUG] - plugin oceanbase-ce-py_script_resource_check-4.0.0.0 result: True
[2025-05-02 19:06:35.053] [DEBUG] - Searching environment_check plugin for components …
[2025-05-02 19:06:35.053] [DEBUG] - Searching environment_check plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:06:35.053] [DEBUG] - Found for oceanbase-ce-py_script_environment_check-4.2.0.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:06:35.054] [DEBUG] - Call plugin oceanbase-ce-py_script_environment_check-4.2.0.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:06:35.054] [DEBUG] - import environment_check
[2025-05-02 19:06:35.055] [DEBUG] - add environment_check ref count to 1
[2025-05-02 19:06:35.055] [DEBUG] – 192.168.153.66 port check
[2025-05-02 19:06:35.055] [DEBUG] – root@192.168.153.66 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B41’ | awk -F’ ’ ‘{print $3}’ | uniq
[2025-05-02 19:06:45.721] [DEBUG] – exited code 0
[2025-05-02 19:06:45.722] [DEBUG] – root@192.168.153.66 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B42’ | awk -F’ ’ ‘{print $3}’ | uniq
[2025-05-02 19:06:46.053] [DEBUG] – exited code 0
[2025-05-02 19:06:46.053] [DEBUG] – root@192.168.153.66 execute: ping -W 1 -c 1 127.0.0.1
[2025-05-02 19:06:51.502] [DEBUG] – exited code 0
[2025-05-02 19:06:51.502] [DEBUG] - sub environment_check ref count to 0
[2025-05-02 19:06:51.502] [DEBUG] - export environment_check
[2025-05-02 19:06:51.502] [DEBUG] - plugin oceanbase-ce-py_script_environment_check-4.2.0.0 result: True
[2025-05-02 19:06:51.502] [DEBUG] - Searching obshell_port_check plugin for components …
[2025-05-02 19:06:51.503] [DEBUG] - Searching obshell_port_check plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:06:51.503] [DEBUG] - Found for oceanbase-ce-py_script_obshell_port_check-4.2.1.4 for oceanbase-ce-4.3.5.1
[2025-05-02 19:06:51.503] [DEBUG] - Call plugin oceanbase-ce-py_script_obshell_port_check-4.2.1.4 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:06:51.503] [DEBUG] - import obshell_port_check
[2025-05-02 19:06:51.504] [DEBUG] - add obshell_port_check ref count to 1
[2025-05-02 19:06:51.505] [DEBUG] – root@192.168.153.66 execute: cat /root/observer/run/obshell.pid
[2025-05-02 19:06:56.905] [DEBUG] – exited code 1, error output:
[2025-05-02 19:06:56.905] [DEBUG] cat: /root/observer/run/obshell.pid: No such file or directory
[2025-05-02 19:06:56.905] [DEBUG]
[2025-05-02 19:06:56.905] [DEBUG] – 192.168.153.66 port check
[2025-05-02 19:06:56.905] [DEBUG] – root@192.168.153.66 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B46’ | awk -F’ ’ ‘{print $3}’ | uniq
[2025-05-02 19:07:07.541] [DEBUG] – exited code 0
[2025-05-02 19:07:07.541] [DEBUG] - sub obshell_port_check ref count to 0
[2025-05-02 19:07:07.541] [DEBUG] - export obshell_port_check
[2025-05-02 19:07:07.541] [DEBUG] - plugin oceanbase-ce-py_script_obshell_port_check-4.2.1.4 result: True
[2025-05-02 19:07:07.541] [DEBUG] - Searching scenario_start_check plugin for components …
[2025-05-02 19:07:07.541] [DEBUG] - Searching scenario_start_check plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:07.542] [DEBUG] - Found for oceanbase-ce-py_script_scenario_start_check-4.3.0.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:07:07.542] [DEBUG] - Call plugin oceanbase-ce-py_script_scenario_start_check-4.3.0.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:07.542] [DEBUG] - import scenario_start_check
[2025-05-02 19:07:07.542] [DEBUG] - add scenario_start_check ref count to 1
[2025-05-02 19:07:07.542] [DEBUG] - sub scenario_start_check ref count to 0
[2025-05-02 19:07:07.543] [DEBUG] - export scenario_start_check
[2025-05-02 19:07:07.543] [DEBUG] - plugin oceanbase-ce-py_script_scenario_start_check-4.3.0.0 result: True
[2025-05-02 19:07:07.543] [DEBUG] - Searching ocp_tenant_check plugin for components …
[2025-05-02 19:07:07.543] [DEBUG] - Searching ocp_tenant_check plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:07.543] [DEBUG] - Found for oceanbase-ce-py_script_ocp_tenant_check-4.0.0.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:07:07.543] [DEBUG] - Call plugin oceanbase-ce-py_script_ocp_tenant_check-4.0.0.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:07.543] [DEBUG] - import ocp_tenant_check
[2025-05-02 19:07:07.544] [DEBUG] - add ocp_tenant_check ref count to 1
[2025-05-02 19:07:07.544] [DEBUG] - sub ocp_tenant_check ref count to 0
[2025-05-02 19:07:07.544] [DEBUG] - export ocp_tenant_check
[2025-05-02 19:07:07.544] [DEBUG] - plugin oceanbase-ce-py_script_ocp_tenant_check-4.0.0.0 result: True
[2025-05-02 19:07:07.544] [DEBUG] - Searching start template for components …
[2025-05-02 19:07:07.545] [DEBUG] - Call workflow oceanbase-ce-py_script_workflow_start-4.2.1.4 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:07.545] [DEBUG] - import start
[2025-05-02 19:07:07.545] [DEBUG] - add start ref count to 1
[2025-05-02 19:07:07.545] [DEBUG] - sub start ref count to 0
[2025-05-02 19:07:07.545] [DEBUG] - export start
[2025-05-02 19:07:07.546] [DEBUG] - plugin oceanbase-ce-py_script_workflow_start-4.2.1.4 result: True
[2025-05-02 19:07:07.546] [DEBUG] - Found for oceanbase-ce-py_script_workflow_start-4.2.1.4 for oceanbase-ce-4.2.1.4
[2025-05-02 19:07:07.546] [DEBUG] - Searching configserver_pre plugin for components …
[2025-05-02 19:07:07.546] [DEBUG] - Searching configserver_pre plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:07.546] [DEBUG] - Found for oceanbase-ce-py_script_configserver_pre-3.1.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:07:07.546] [DEBUG] - Call plugin oceanbase-ce-py_script_configserver_pre-3.1.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:07.546] [DEBUG] - import configserver_pre
[2025-05-02 19:07:07.547] [DEBUG] - add configserver_pre ref count to 1
[2025-05-02 19:07:07.547] [DEBUG] - sub configserver_pre ref count to 0
[2025-05-02 19:07:07.547] [DEBUG] - export configserver_pre
[2025-05-02 19:07:07.547] [DEBUG] - plugin oceanbase-ce-py_script_configserver_pre-3.1.0 result: True
[2025-05-02 19:07:07.547] [DEBUG] - Searching start_pre plugin for components …
[2025-05-02 19:07:07.547] [DEBUG] - Searching start_pre plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:07.548] [DEBUG] - Found for oceanbase-ce-py_script_start_pre-4.3.0.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:07:07.548] [DEBUG] - Call plugin oceanbase-ce-py_script_start_pre-4.3.0.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:07.548] [DEBUG] - import start_pre
[2025-05-02 19:07:07.549] [DEBUG] - add start_pre ref count to 1
[2025-05-02 19:07:07.549] [INFO] cluster scenario: htap
[2025-05-02 19:07:07.550] [DEBUG] – root@192.168.153.66 execute: ls /data/1/clog/tenant_1/
[2025-05-02 19:07:12.949] [DEBUG] – exited code 2, error output:
[2025-05-02 19:07:12.949] [DEBUG] ls: cannot access /data/1/clog/tenant_1/: No such file or directory
[2025-05-02 19:07:12.949] [DEBUG]
[2025-05-02 19:07:12.949] [DEBUG] – root@192.168.153.66 execute: cat /root/observer/run/observer.pid
[2025-05-02 19:07:13.178] [DEBUG] – exited code 0
[2025-05-02 19:07:13.178] [DEBUG] – root@192.168.153.66 execute: ls /proc/14811
[2025-05-02 19:07:13.449] [DEBUG] – exited code 2, error output:
[2025-05-02 19:07:13.450] [DEBUG] ls: cannot access /proc/14811: No such file or directory
[2025-05-02 19:07:13.450] [DEBUG]
[2025-05-02 19:07:13.450] [DEBUG] – 192.168.153.66 start command construction
[2025-05-02 19:07:13.450] [DEBUG] – update large_query_threshold to 600s because of scenario
[2025-05-02 19:07:13.450] [DEBUG] – update enable_record_trace_log to False because of scenario
[2025-05-02 19:07:13.450] [DEBUG] – update enable_syslog_recycle to 1 because of scenario
[2025-05-02 19:07:13.450] [DEBUG] – update max_syslog_file_count to 300 because of scenario
[2025-05-02 19:07:13.450] [DEBUG] - sub start_pre ref count to 0
[2025-05-02 19:07:13.450] [DEBUG] - export start_pre
[2025-05-02 19:07:13.450] [DEBUG] - plugin oceanbase-ce-py_script_start_pre-4.3.0.0 result: True
[2025-05-02 19:07:13.450] [DEBUG] - Searching start plugin for components …
[2025-05-02 19:07:13.450] [DEBUG] - Searching start plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:13.451] [DEBUG] - Found for oceanbase-ce-py_script_start-3.1.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:07:13.451] [DEBUG] - Call plugin oceanbase-ce-py_script_start-3.1.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:13.451] [DEBUG] - import start
[2025-05-02 19:07:13.451] [DEBUG] - add start ref count to 1
[2025-05-02 19:07:13.453] [INFO] Start observer
[2025-05-02 19:07:13.454] [DEBUG] – starting 192.168.153.66 observer
[2025-05-02 19:07:13.454] [DEBUG] – root@192.168.153.66 export LD_LIBRARY_PATH=’/root/observer/lib:’
[2025-05-02 19:07:13.454] [DEBUG] – root@192.168.153.66 execute: cd /root/observer; /root/observer/bin/observer -r ‘192.168.153.66:2882:2881’ -p 2881 -P 2882 -z ‘zone1’ -n ‘obtest’ -c 1 -d ‘/data/1’ -I ‘192.168.153.66’ -o __min_full_resource_pool_memory=2147483648,memory_limit=‘6G’,system_memory=‘5G’,datafile_size=‘2G’,datafile_next=‘2G’,datafile_maxsize=‘20G’,log_disk_size=‘14G’,cpu_count=16,enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,large_query_threshold=‘600s’,enable_record_trace_log=False
[2025-05-02 19:07:13.877] [DEBUG] – exited code 0
[2025-05-02 19:07:13.877] [DEBUG] – root@192.168.153.66 delete env LD_LIBRARY_PATH
[2025-05-02 19:07:14.003] [DEBUG] – need_bootstrap: True
[2025-05-02 19:07:14.003] [DEBUG] - sub start ref count to 0
[2025-05-02 19:07:14.004] [DEBUG] - export start
[2025-05-02 19:07:14.004] [DEBUG] - plugin oceanbase-ce-py_script_start-3.1.0 result: True
[2025-05-02 19:07:14.004] [DEBUG] - Searching health_check plugin for components …
[2025-05-02 19:07:14.004] [DEBUG] - Searching health_check plugin for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:14.004] [DEBUG] - Found for oceanbase-ce-py_script_health_check-3.1.0 for oceanbase-ce-4.3.5.1
[2025-05-02 19:07:14.004] [DEBUG] - Call plugin oceanbase-ce-py_script_health_check-3.1.0 for oceanbase-ce-4.3.5.1-101010042025042417.el7-f4041930aada05b85182f5134cd7f3d3f5cf5f70
[2025-05-02 19:07:14.005] [DEBUG] - import health_check
[2025-05-02 19:07:14.005] [DEBUG] - add health_check ref count to 1
[2025-05-02 19:07:14.005] [INFO] observer program health check
[2025-05-02 19:07:17.007] [DEBUG] – 192.168.153.66 program health check
[2025-05-02 19:07:17.007] [DEBUG] – root@192.168.153.66 execute: cat /root/observer/run/observer.pid
[2025-05-02 19:07:22.327] [DEBUG] – exited code 0
[2025-05-02 19:07:22.327] [DEBUG] – root@192.168.153.66 execute: ls /proc/16096
[2025-05-02 19:07:32.889] [DEBUG] – exited code 2, error output:
[2025-05-02 19:07:32.889] [DEBUG] ls: cannot access /proc/16096: No such file or directory
[2025-05-02 19:07:32.889] [DEBUG]
[2025-05-02 19:07:33.004] [WARNING] OBD-2002: Failed to start 192.168.153.66 observer
[2025-05-02 19:07:33.005] [DEBUG] - sub health_check ref count to 0
[2025-05-02 19:07:33.005] [DEBUG] - export health_check
[2025-05-02 19:07:33.005] [DEBUG] - plugin oceanbase-ce-py_script_health_check-3.1.0 result: False
[2025-05-02 19:07:33.009] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 1
[2025-05-02 19:07:33.009] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 0
[2025-05-02 19:07:33.009] [DEBUG] - unlock /root/.obd/lock/mirror_and_repo
[2025-05-02 19:07:33.009] [DEBUG] - exclusive lock /root/.obd/lock/deploy_obtest release, count 0
[2025-05-02 19:07:33.009] [DEBUG] - unlock /root/.obd/lock/deploy_obtest
[2025-05-02 19:07:33.009] [DEBUG] - share lock /root/.obd/lock/global release, count 0
[2025-05-02 19:07:33.009] [DEBUG] - unlock /root/.obd/lock/global
[2025-05-02 19:07:33.009] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes .
[2025-05-02 19:07:33.009] [INFO] Trace ID: 5e981b62-2745-11f0-9459-000c29212bbb
[2025-05-02 19:07:33.009] [INFO] If you want to view detailed obd logs, please run: obd display-trace 5e981b62-2745-11f0-9459-000c29212bbb
========================================
mini-single-example.yaml文件：[root@cjx example]# cat -n mini-single-example.yaml
1 —
2 ## Only need to configure when remote login is required
3 user:
4 username: root
5 password: root@123
6 oceanbase-ce:
7 servers:
8 - 192.168.153.66
9 global:
10 home_path: /root/observer
11 data_dir: /data/1
12 redo_dir: /data/log1
13 mysql_port: 2881
14 rpc_port: 2882
15 obshell_port: 2886
16 zone: zone1
17 cluster_id: 1
18 memory_limit: 8G
19 system_memory: 2G
20 datafile_size: 20G
21 datafile_next: 2G
22 datafile_maxsize: 30G
23 log_disk_size: 14G
24 cpu_count: 16
25 production_mode: false
26 enable_syslog_wf: false
27 enable_syslog_recycle: true
28 max_syslog_file_count: 4
29 root_password: root@123
