[2025-09-09 13:59:37.028] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - cmd: ['bbcluster'] [2025-09-09 13:59:37.028] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - opts: {'servers': None, 'components': None, 'with_parameter': None} [2025-09-09 13:59:37.029] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/lock/ [2025-09-09 13:59:37.029] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - unknown lock mode [2025-09-09 13:59:37.029] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2025-09-09 13:59:37.029] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2025-09-09 13:59:37.029] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Get Deploy by name [2025-09-09 13:59:37.029] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2025-09-09 13:59:37.029] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2025-09-09 13:59:37.029] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_bbcluster [2025-09-09 13:59:37.029] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_bbcluster`, count 1 [2025-09-09 13:59:37.033] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Get local repositories and plugins [2025-09-09 13:59:37.033] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/repository [2025-09-09 13:59:37.033] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Get local repository oceanbase-standalone-4.3.5.3-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.033] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2025-09-09 13:59:37.033] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2025-09-09 13:59:37.042] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Load cluster param plugin [2025-09-09 13:59:37.042] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching param plugin for components ... [2025-09-09 13:59:37.042] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Search param plugin for oceanbase-standalone [2025-09-09 13:59:37.042] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/plugins [2025-09-09 13:59:37.043] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-param-4.3.3.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:37.043] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Applying oceanbase-standalone-param-4.3.3.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.424] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Open ssh connection [2025-09-09 13:59:37.427] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - host: 10.186.56.11, port: 22, user: admin, password: ****** [2025-09-09 13:59:37.545] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Cluster status check [2025-09-09 13:59:37.545] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching status template for components ... [2025-09-09 13:59:37.546] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/workflows [2025-09-09 13:59:37.548] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call workflow oceanbase-standalone-py_script_workflow_status-0.1 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.549] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/mirror [2025-09-09 13:59:37.549] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/mirror/remote [2025-09-09 13:59:37.550] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/mirror/local [2025-09-09 13:59:37.550] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/optimize/ [2025-09-09 13:59:37.551] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/tool/ [2025-09-09 13:59:37.551] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import status [2025-09-09 13:59:37.552] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add status ref count to 1 [2025-09-09 13:59:37.553] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub status ref count to 0 [2025-09-09 13:59:37.553] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export status [2025-09-09 13:59:37.553] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_workflow_status-0.1 result: True [2025-09-09 13:59:37.553] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_workflow_status-0.1 for oceanbase-standalone-0.1 [2025-09-09 13:59:37.554] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2025-09-09 13:59:37.559] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching status plugin for components ... [2025-09-09 13:59:37.559] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching status plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.561] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_status-3.1.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:37.561] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_status-3.1.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.561] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import status [2025-09-09 13:59:37.563] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add status ref count to 1 [2025-09-09 13:59:37.564] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/observer.pid [2025-09-09 13:59:37.645] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:37.646] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ls /proc/9805 [2025-09-09 13:59:37.726] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:37.727] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub status ref count to 0 [2025-09-09 13:59:37.727] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export status [2025-09-09 13:59:37.727] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_status-3.1.0 result: True [2025-09-09 13:59:37.728] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching restart_pre template for components ... [2025-09-09 13:59:37.730] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call workflow oceanbase-standalone-py_script_workflow_restart_pre-4.0.0.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.731] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import restart_pre [2025-09-09 13:59:37.732] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add restart_pre ref count to 1 [2025-09-09 13:59:37.732] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub restart_pre ref count to 0 [2025-09-09 13:59:37.733] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export restart_pre [2025-09-09 13:59:37.733] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_workflow_restart_pre-4.0.0.0 result: True [2025-09-09 13:59:37.733] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_workflow_restart_pre-4.0.0.0 for oceanbase-standalone-4.0.0.0 [2025-09-09 13:59:37.733] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching start_check_pre plugin for components ... [2025-09-09 13:59:37.734] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching start_check_pre plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.735] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_start_check_pre-4.3.0.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:37.735] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_start_check_pre-4.3.0.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.736] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import start_check_pre [2025-09-09 13:59:37.740] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add start_check_pre ref count to 1 [2025-09-09 13:59:37.742] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub start_check_pre ref count to 0 [2025-09-09 13:59:37.742] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export start_check_pre [2025-09-09 13:59:37.742] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_start_check_pre-4.3.0.0 result: True [2025-09-09 13:59:37.742] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching status_check plugin for components ... [2025-09-09 13:59:37.742] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching status_check plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.744] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_status_check-4.2.1.4 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:37.744] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_status_check-4.2.1.4 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.744] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import status_check [2025-09-09 13:59:37.746] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add status_check ref count to 1 [2025-09-09 13:59:37.747] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ls /data/1/clog/tenant_1/ [2025-09-09 13:59:37.808] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:37.808] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/observer.pid [2025-09-09 13:59:37.888] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:37.889] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ls /proc/9805 [2025-09-09 13:59:37.972] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:37.973] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- 10.186.56.11 is runnning, skip [2025-09-09 13:59:37.974] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub status_check ref count to 0 [2025-09-09 13:59:37.974] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export status_check [2025-09-09 13:59:37.974] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_status_check-4.2.1.4 result: True [2025-09-09 13:59:37.974] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching parameter_check plugin for components ... [2025-09-09 13:59:37.975] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching parameter_check plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.977] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_parameter_check-4.0.0.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:37.977] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_parameter_check-4.0.0.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.977] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import parameter_check [2025-09-09 13:59:37.981] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add parameter_check ref count to 1 [2025-09-09 13:59:37.982] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub parameter_check ref count to 0 [2025-09-09 13:59:37.982] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export parameter_check [2025-09-09 13:59:37.983] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_parameter_check-4.0.0.0 result: True [2025-09-09 13:59:37.983] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching system_limits_check plugin for components ... [2025-09-09 13:59:37.983] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching system_limits_check plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.984] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_system_limits_check-3.1.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:37.984] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_system_limits_check-3.1.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:37.985] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import system_limits_check [2025-09-09 13:59:37.988] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add system_limits_check ref count to 1 [2025-09-09 13:59:37.989] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2025-09-09 13:59:38.053] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:38.054] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: bash -c "ulimit -a" [2025-09-09 13:59:38.136] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:38.138] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: sysctl -a [2025-09-09 13:59:38.245] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:38.249] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub system_limits_check ref count to 0 [2025-09-09 13:59:38.249] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export system_limits_check [2025-09-09 13:59:38.249] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_system_limits_check-3.1.0 result: True [2025-09-09 13:59:38.249] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching resource_check plugin for components ... [2025-09-09 13:59:38.249] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching resource_check plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:38.250] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_resource_check-4.0.0.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:38.250] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_resource_check-4.0.0.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:38.250] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import resource_check [2025-09-09 13:59:38.253] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add resource_check ref count to 1 [2025-09-09 13:59:38.253] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /proc/meminfo [2025-09-09 13:59:38.320] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:38.322] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: df --block-size=1024 [2025-09-09 13:59:38.401] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:38.403] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- get disk info for path /dev, total: 8302628864 avail: 8302628864 [2025-09-09 13:59:38.403] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- get disk info for path /dev/shm, total: 8327860224 avail: 8327860224 [2025-09-09 13:59:38.403] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- get disk info for path /run, total: 8327860224 avail: 8310300672 [2025-09-09 13:59:38.403] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 8327860224 avail: 8327860224 [2025-09-09 13:59:38.404] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- get disk info for path /, total: 429485174784 avail: 268898734080 [2025-09-09 13:59:38.404] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- get disk info for path /run/user/0, total: 1665572864 avail: 1665572864 [2025-09-09 13:59:38.404] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- get disk info for path /run/user/500, total: 1665572864 avail: 1665572864 [2025-09-09 13:59:38.404] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- disk: {'/dev': {'total': 8302628864, 'avail': 8302628864, 'need': 0}, '/dev/shm': {'total': 8327860224, 'avail': 8327860224, 'need': 0}, '/run': {'total': 8327860224, 'avail': 8310300672, 'need': 0}, '/sys/fs/cgroup': {'total': 8327860224, 'avail': 8327860224, 'need': 0}, '/': {'total': 429485174784, 'avail': 268898734080, 'need': 0}, '/run/user/0': {'total': 1665572864, 'avail': 1665572864, 'need': 0}, '/run/user/500': {'total': 1665572864, 'avail': 1665572864, 'need': 0}} [2025-09-09 13:59:38.405] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: date +%s%N [2025-09-09 13:59:38.479] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:38.479] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- 10.186.56.11 time delta 35.384521484375 [2025-09-09 13:59:38.480] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub resource_check ref count to 0 [2025-09-09 13:59:38.480] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export resource_check [2025-09-09 13:59:38.480] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_resource_check-4.0.0.0 result: True [2025-09-09 13:59:38.480] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching environment_check plugin for components ... [2025-09-09 13:59:38.480] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching environment_check plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:38.481] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_environment_check-4.2.0.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:38.481] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_environment_check-4.2.0.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:38.481] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import environment_check [2025-09-09 13:59:38.483] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add environment_check ref count to 1 [2025-09-09 13:59:38.483] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: lscpu | grep avx [2025-09-09 13:59:38.560] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:38.561] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub environment_check ref count to 0 [2025-09-09 13:59:38.561] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export environment_check [2025-09-09 13:59:38.561] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_environment_check-4.2.0.0 result: True [2025-09-09 13:59:38.561] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching ocp_tenant_check plugin for components ... [2025-09-09 13:59:38.561] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching ocp_tenant_check plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:38.562] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_ocp_tenant_check-4.0.0.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:38.562] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_ocp_tenant_check-4.0.0.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:38.562] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import ocp_tenant_check [2025-09-09 13:59:38.563] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add ocp_tenant_check ref count to 1 [2025-09-09 13:59:38.563] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub ocp_tenant_check ref count to 0 [2025-09-09 13:59:38.564] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export ocp_tenant_check [2025-09-09 13:59:38.564] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_ocp_tenant_check-4.0.0.0 result: True [2025-09-09 13:59:38.564] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching connect plugin for components ... [2025-09-09 13:59:38.564] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching connect plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:38.564] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_connect-3.1.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:38.565] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_connect-3.1.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:38.565] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import connect [2025-09-09 13:59:38.566] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add connect ref count to 1 [2025-09-09 13:59:38.566] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Connect to observer [2025-09-09 13:59:38.566] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql connect 10.186.56.11 -P2881 -uroot -p****** [2025-09-09 13:59:38.590] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql execute sql: select 1. args: None [2025-09-09 13:59:38.593] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub connect ref count to 0 [2025-09-09 13:59:38.593] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export connect [2025-09-09 13:59:38.594] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_connect-3.1.0 result: True [2025-09-09 13:59:38.594] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching restart_pre plugin for components ... [2025-09-09 13:59:38.594] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching restart_pre plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:38.596] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_restart_pre-4.2.1.4 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:38.597] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_restart_pre-4.2.1.4 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:38.597] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import restart_pre [2025-09-09 13:59:38.600] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add restart_pre ref count to 1 [2025-09-09 13:59:38.601] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql connect 10.186.56.11 -P2881 -uroot -p****** [2025-09-09 13:59:38.604] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql execute sql: select 1. args: None [2025-09-09 13:59:41.606] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql execute sql: use oceanbase. args: None [2025-09-09 13:59:41.608] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql execute sql: set session ob_query_timeout=1000000000. args: None [2025-09-09 13:59:41.610] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Server check [2025-09-09 13:59:41.610] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql execute sql: select * from oceanbase.__all_server. args: None [2025-09-09 13:59:41.615] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- [{'gmt_create': datetime.datetime(2025, 9, 9, 10, 34, 37, 576940), 'gmt_modified': datetime.datetime(2025, 9, 9, 13, 54, 55, 13968), 'svr_ip': '10.186.56.11', 'svr_port': 2882, 'id': 1, 'zone': 'zone1', 'inner_port': 2881, 'with_rootserver': 1, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.3.5.3_103000112025071821-4b8c513fcc2194bad9eb2f93c789040f6dd01f11(Jul 18 2025 21:12:47)', 'stop_time': 0, 'start_service_time': 1757397294207782, 'first_sessid': 0, 'with_partition': 1, 'last_offline_time': 0}] [2025-09-09 13:59:41.616] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub restart_pre ref count to 0 [2025-09-09 13:59:41.616] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export restart_pre [2025-09-09 13:59:41.616] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_restart_pre-4.2.1.4 result: True [2025-09-09 13:59:41.616] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching restart template for components ... [2025-09-09 13:59:41.618] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call workflow oceanbase-standalone-py_script_workflow_restart-4.2.1.4 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:41.619] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import restart [2025-09-09 13:59:41.621] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add restart ref count to 1 [2025-09-09 13:59:41.622] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub restart ref count to 0 [2025-09-09 13:59:41.622] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export restart [2025-09-09 13:59:41.622] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_workflow_restart-4.2.1.4 result: True [2025-09-09 13:59:41.623] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_workflow_restart-4.2.1.4 for oceanbase-standalone-4.2.1.4 [2025-09-09 13:59:41.623] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching stop plugin for components ... [2025-09-09 13:59:41.623] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching stop plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:41.625] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_stop-4.2.1.4 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:41.626] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_stop-4.2.1.4 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:41.626] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import stop [2025-09-09 13:59:41.629] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add stop ref count to 1 [2025-09-09 13:59:41.630] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Stop observer [2025-09-09 13:59:41.630] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/observer.pid [2025-09-09 13:59:41.669] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:41.671] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ps uax | egrep " 9805 " | grep -v grep [2025-09-09 13:59:41.774] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:41.774] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- 10.186.56.11 observer[pid:9805] stopping ... [2025-09-09 13:59:41.775] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: kill -9 9805 [2025-09-09 13:59:41.854] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:42.856] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- 10.186.56.11 check whether the port is released [2025-09-09 13:59:42.857] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2025-09-09 13:59:42.906] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:42.907] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2025-09-09 13:59:42.993] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:42.993] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: rm -f /home/admin/bbcluster/oceanbase/run/observer.pid [2025-09-09 13:59:43.072] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:43.072] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- 10.186.56.11 observer is stopped [2025-09-09 13:59:43.073] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub stop ref count to 0 [2025-09-09 13:59:43.073] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export stop [2025-09-09 13:59:43.073] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_stop-4.2.1.4 result: True [2025-09-09 13:59:43.074] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching obshell_stop plugin for components ... [2025-09-09 13:59:43.074] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching obshell_stop plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:43.075] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_obshell_stop-4.2.1.4 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:43.076] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_obshell_stop-4.2.1.4 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:43.076] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import obshell_stop [2025-09-09 13:59:43.078] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add obshell_stop ref count to 1 [2025-09-09 13:59:43.079] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Stop obshell [2025-09-09 13:59:43.079] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- 10.186.56.11 obshell stopping ... [2025-09-09 13:59:43.079] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ls /home/admin/bbcluster/oceanbase/bin/obshell [2025-09-09 13:59:43.153] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:43.154] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cd /home/admin/bbcluster/oceanbase; /home/admin/bbcluster/oceanbase/bin/obshell admin stop [2025-09-09 13:59:43.393] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:43.394] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/obshell.pid [2025-09-09 13:59:43.473] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 1, error output: [2025-09-09 13:59:43.474] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] cat: /home/admin/bbcluster/oceanbase/run/obshell.pid: No such file or directory [2025-09-09 13:59:43.474] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] [2025-09-09 13:59:43.474] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/daemon.pid [2025-09-09 13:59:43.551] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:43.552] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ps uax | egrep " 10435 " | grep -v grep [2025-09-09 13:59:43.651] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 1, error output: [2025-09-09 13:59:43.651] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] [2025-09-09 13:59:43.653] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub obshell_stop ref count to 0 [2025-09-09 13:59:43.653] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export obshell_stop [2025-09-09 13:59:43.653] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_obshell_stop-4.2.1.4 result: True [2025-09-09 13:59:43.654] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching configserver_pre plugin for components ... [2025-09-09 13:59:43.654] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching configserver_pre plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:43.655] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_configserver_pre-3.1.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:43.656] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_configserver_pre-3.1.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:43.656] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import configserver_pre [2025-09-09 13:59:43.659] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add configserver_pre ref count to 1 [2025-09-09 13:59:43.660] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub configserver_pre ref count to 0 [2025-09-09 13:59:43.660] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export configserver_pre [2025-09-09 13:59:43.660] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_configserver_pre-3.1.0 result: True [2025-09-09 13:59:43.660] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching start_pre plugin for components ... [2025-09-09 13:59:43.660] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching start_pre plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:43.662] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_start_pre-4.2.5.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:43.662] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_start_pre-4.2.5.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:43.662] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import start_pre [2025-09-09 13:59:43.665] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add start_pre ref count to 1 [2025-09-09 13:59:43.667] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] cluster scenario: htap [2025-09-09 13:59:43.667] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ls /data/1/clog/tenant_1/ [2025-09-09 13:59:43.732] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:43.733] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/observer.pid [2025-09-09 13:59:43.813] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 1, error output: [2025-09-09 13:59:43.814] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] cat: /home/admin/bbcluster/oceanbase/run/observer.pid: No such file or directory [2025-09-09 13:59:43.814] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] [2025-09-09 13:59:43.814] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- 10.186.56.11 start command construction [2025-09-09 13:59:43.815] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ls /home/admin/bbcluster/oceanbase/etc/observer.config.bin [2025-09-09 13:59:43.893] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:43.894] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub start_pre ref count to 0 [2025-09-09 13:59:43.894] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export start_pre [2025-09-09 13:59:43.895] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_start_pre-4.2.5.0 result: True [2025-09-09 13:59:43.895] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching start plugin for components ... [2025-09-09 13:59:43.895] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching start plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:43.897] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_start-3.1.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:43.897] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_start-3.1.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:43.898] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import start [2025-09-09 13:59:43.899] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add start ref count to 1 [2025-09-09 13:59:43.900] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Start observer [2025-09-09 13:59:43.901] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- starting 10.186.56.11 observer [2025-09-09 13:59:43.901] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 export LD_LIBRARY_PATH='/home/admin/bbcluster/oceanbase/lib:' [2025-09-09 13:59:43.902] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cd /home/admin/bbcluster/oceanbase; /home/admin/bbcluster/oceanbase/bin/observer -p 2881 [2025-09-09 13:59:44.253] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:44.254] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 delete env LD_LIBRARY_PATH [2025-09-09 13:59:44.254] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- need_bootstrap: False [2025-09-09 13:59:44.255] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub start ref count to 0 [2025-09-09 13:59:44.255] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export start [2025-09-09 13:59:44.255] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_start-3.1.0 result: True [2025-09-09 13:59:44.255] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching health_check plugin for components ... [2025-09-09 13:59:44.255] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching health_check plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:44.257] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_health_check-3.1.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:44.257] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_health_check-3.1.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:44.257] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import health_check [2025-09-09 13:59:44.259] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add health_check ref count to 1 [2025-09-09 13:59:44.259] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] observer program health check [2025-09-09 13:59:47.262] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- 10.186.56.11 program health check [2025-09-09 13:59:47.263] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/observer.pid [2025-09-09 13:59:47.304] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:47.305] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ls /proc/13429 [2025-09-09 13:59:47.386] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:47.387] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- 10.186.56.11 observer[pid: 13429] started [2025-09-09 13:59:47.388] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub health_check ref count to 0 [2025-09-09 13:59:47.389] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export health_check [2025-09-09 13:59:47.389] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_health_check-3.1.0 result: True [2025-09-09 13:59:47.389] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching obshell_start plugin for components ... [2025-09-09 13:59:47.390] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching obshell_start plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:47.391] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_obshell_start-4.2.1.4 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:47.391] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_obshell_start-4.2.1.4 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:47.392] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import obshell_start [2025-09-09 13:59:47.394] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add obshell_start ref count to 1 [2025-09-09 13:59:47.394] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- start_obshell: True [2025-09-09 13:59:47.395] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] obshell start [2025-09-09 13:59:47.396] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/obshell.pid [2025-09-09 13:59:47.467] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 1, error output: [2025-09-09 13:59:47.467] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] cat: /home/admin/bbcluster/oceanbase/run/obshell.pid: No such file or directory [2025-09-09 13:59:47.467] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] [2025-09-09 13:59:47.468] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 export OB_ROOT_PASSWORD=****** [2025-09-09 13:59:47.468] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- start obshell: cd /home/admin/bbcluster/oceanbase; /home/admin/bbcluster/oceanbase/bin/obshell admin start --ip 10.186.56.11 --port 2886 [2025-09-09 13:59:47.468] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cd /home/admin/bbcluster/oceanbase; /home/admin/bbcluster/oceanbase/bin/obshell admin start --ip 10.186.56.11 --port 2886 [2025-09-09 13:59:49.686] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:49.688] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] obshell program health check [2025-09-09 13:59:49.688] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/obshell.pid [2025-09-09 13:59:49.759] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:49.759] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- Get 10.186.56.11 obshell[pid: 13961] [2025-09-09 13:59:49.760] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ls /proc/13961 [2025-09-09 13:59:49.837] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:49.838] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- 10.186.56.11 obshell[pid: 13961] started [2025-09-09 13:59:49.839] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub obshell_start ref count to 0 [2025-09-09 13:59:49.839] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export obshell_start [2025-09-09 13:59:49.839] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_obshell_start-4.2.1.4 result: True [2025-09-09 13:59:49.840] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching obshell_bootstrap plugin for components ... [2025-09-09 13:59:49.840] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching obshell_bootstrap plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:49.842] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_obshell_bootstrap-4.2.1.4 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:49.842] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_obshell_bootstrap-4.2.1.4 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:49.842] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import obshell_bootstrap [2025-09-09 13:59:49.937] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add obshell_bootstrap ref count to 1 [2025-09-09 13:59:49.938] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub obshell_bootstrap ref count to 0 [2025-09-09 13:59:49.938] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export obshell_bootstrap [2025-09-09 13:59:49.939] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_obshell_bootstrap-4.2.1.4 result: True [2025-09-09 13:59:49.939] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching connect plugin for components ... [2025-09-09 13:59:49.939] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching connect plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:49.941] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_connect-3.1.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:49.941] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_connect-3.1.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:49.942] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Connect to observer [2025-09-09 13:59:49.943] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql connect 10.186.56.11 -P2881 -uroot -p****** [2025-09-09 13:59:49.969] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql execute sql: select 1. args: None [2025-09-09 13:59:49.973] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_connect-3.1.0 result: True [2025-09-09 13:59:49.973] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching display plugin for components ... [2025-09-09 13:59:49.973] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Searching display plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:49.975] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_display-3.1.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:49.975] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_display-3.1.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:49.976] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - import display [2025-09-09 13:59:49.979] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - add display ref count to 1 [2025-09-09 13:59:49.980] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Wait for observer init [2025-09-09 13:59:49.980] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql execute sql: select * from oceanbase.__all_server. args: None [2025-09-09 13:59:50.002] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] +------------------------------------------------+ [2025-09-09 13:59:50.003] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] | oceanbase-standalone | [2025-09-09 13:59:50.003] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] +--------------+---------+------+-------+--------+ [2025-09-09 13:59:50.003] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] | ip | version | port | zone | status | [2025-09-09 13:59:50.003] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] +--------------+---------+------+-------+--------+ [2025-09-09 13:59:50.003] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] | 10.186.56.11 | 4.3.5.3 | 2881 | zone1 | ACTIVE | [2025-09-09 13:59:50.003] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] +--------------+---------+------+-------+--------+ [2025-09-09 13:59:50.004] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] obclient -h10.186.56.11 -P2881 -uroot@sys -p'******' -Doceanbase -A [2025-09-09 13:59:50.004] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] +------------------------------------------------+ [2025-09-09 13:59:50.004] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] | oceanbase-standalone | [2025-09-09 13:59:50.005] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] +--------------+---------+------+-------+--------+ [2025-09-09 13:59:50.005] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] | ip | version | port | zone | status | [2025-09-09 13:59:50.005] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] +--------------+---------+------+-------+--------+ [2025-09-09 13:59:50.005] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] | 10.186.56.11 | 4.3.5.3 | 2881 | zone1 | ACTIVE | [2025-09-09 13:59:50.005] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] +--------------+---------+------+-------+--------+ [2025-09-09 13:59:50.005] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] obclient -h10.186.56.11 -P2881 -uroot@sys -p'******' -Doceanbase -A [2025-09-09 13:59:50.005] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] [2025-09-09 13:59:50.006] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] -- mysql execute sql: select unix_timestamp(gmt_create) as gmt_create from oceanbase.__all_virtual_sys_variable limit 1. args: None [2025-09-09 13:59:50.020] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] cluster unique id: 550ee57b-1fb0-584f-a36d-38eb1b530c23-1992c534382-03050304 [2025-09-09 13:59:50.020] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] [2025-09-09 13:59:50.020] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - sub display ref count to 0 [2025-09-09 13:59:50.020] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - export display [2025-09-09 13:59:50.021] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_display-3.1.0 result: True [2025-09-09 13:59:50.021] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - Set bbcluster deploy status to running [2025-09-09 13:59:50.021] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/bbcluster/.data [2025-09-09 13:59:50.026] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] bbcluster restart [2025-09-09 13:59:50.034] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2025-09-09 13:59:50.034] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2025-09-09 13:59:50.035] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2025-09-09 13:59:50.035] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_bbcluster release, count 0 [2025-09-09 13:59:50.035] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - unlock /home/admin/.obd/lock/deploy_bbcluster [2025-09-09 13:59:50.035] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2025-09-09 13:59:50.035] [2a957b08-8d42-11f0-ad92-02000aba380b] [DEBUG] - unlock /home/admin/.obd/lock/global [2025-09-09 13:59:50.036] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] Trace ID: 2a957b08-8d42-11f0-ad92-02000aba380b [2025-09-09 13:59:50.036] [2a957b08-8d42-11f0-ad92-02000aba380b] [INFO] If you want to view detailed obd logs, please run: obd display-trace 2a957b08-8d42-11f0-ad92-02000aba380b [2025-09-09 13:59:51.926] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - cmd: ['bbcluster'] [2025-09-09 13:59:51.926] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - opts: {'servers': None, 'components': None} [2025-09-09 13:59:51.926] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/lock/ [2025-09-09 13:59:51.926] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - unknown lock mode [2025-09-09 13:59:51.927] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2025-09-09 13:59:51.927] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2025-09-09 13:59:51.927] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Get Deploy by name [2025-09-09 13:59:51.927] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2025-09-09 13:59:51.927] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2025-09-09 13:59:51.927] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_bbcluster [2025-09-09 13:59:51.927] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_bbcluster`, count 1 [2025-09-09 13:59:51.930] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Check the deploy status [2025-09-09 13:59:51.930] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [INFO] Get local repositories [2025-09-09 13:59:51.931] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/repository [2025-09-09 13:59:51.931] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Get local repository oceanbase-standalone-4.3.5.3-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:51.931] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2025-09-09 13:59:51.931] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2025-09-09 13:59:51.932] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Get deploy config [2025-09-09 13:59:51.940] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [INFO] Get local repositories and plugins [2025-09-09 13:59:51.940] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Get local repository oceanbase-standalone-4.3.5.3-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:51.940] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Searching param plugin for components ... [2025-09-09 13:59:51.940] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Search param plugin for oceanbase-standalone [2025-09-09 13:59:51.940] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/plugins [2025-09-09 13:59:51.940] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Found for oceanbase-standalone-param-4.3.3.0 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:51.940] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Applying oceanbase-standalone-param-4.3.3.0 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:52.293] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [INFO] Open ssh connection [2025-09-09 13:59:52.296] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - host: 10.186.56.11, port: 22, user: admin, password: ****** [2025-09-09 13:59:52.414] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Searching stop template for components ... [2025-09-09 13:59:52.415] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/workflows [2025-09-09 13:59:52.418] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Call workflow oceanbase-standalone-py_script_workflow_stop-4.2.1.4 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:52.418] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/mirror [2025-09-09 13:59:52.419] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/mirror/remote [2025-09-09 13:59:52.419] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/mirror/local [2025-09-09 13:59:52.420] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/optimize/ [2025-09-09 13:59:52.421] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - mkdir /home/admin/.obd/tool/ [2025-09-09 13:59:52.421] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - import stop [2025-09-09 13:59:52.423] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - add stop ref count to 1 [2025-09-09 13:59:52.424] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - sub stop ref count to 0 [2025-09-09 13:59:52.424] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - export stop [2025-09-09 13:59:52.425] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_workflow_stop-4.2.1.4 result: True [2025-09-09 13:59:52.425] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_workflow_stop-4.2.1.4 for oceanbase-standalone-4.2.1.4 [2025-09-09 13:59:52.425] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2025-09-09 13:59:52.431] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Searching stop plugin for components ... [2025-09-09 13:59:52.431] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Searching stop plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:52.433] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_stop-4.2.1.4 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:52.433] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_stop-4.2.1.4 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:52.433] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - import stop [2025-09-09 13:59:52.436] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - add stop ref count to 1 [2025-09-09 13:59:52.437] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [INFO] Stop observer [2025-09-09 13:59:52.438] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/observer.pid [2025-09-09 13:59:52.519] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:52.520] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ps uax | egrep " 13429 " | grep -v grep [2025-09-09 13:59:52.620] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:52.621] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- 10.186.56.11 observer[pid:13429] stopping ... [2025-09-09 13:59:52.622] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: kill -9 13429 [2025-09-09 13:59:52.701] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:53.703] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- 10.186.56.11 check whether the port is released [2025-09-09 13:59:53.703] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2025-09-09 13:59:53.754] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:53.754] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2025-09-09 13:59:53.840] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:53.840] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: rm -f /home/admin/bbcluster/oceanbase/run/observer.pid [2025-09-09 13:59:53.914] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:53.914] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- 10.186.56.11 observer is stopped [2025-09-09 13:59:53.915] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - sub stop ref count to 0 [2025-09-09 13:59:53.915] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - export stop [2025-09-09 13:59:53.915] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_stop-4.2.1.4 result: True [2025-09-09 13:59:53.915] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Searching obshell_stop plugin for components ... [2025-09-09 13:59:53.915] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Searching obshell_stop plugin for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:53.916] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Found for oceanbase-standalone-py_script_obshell_stop-4.2.1.4 for oceanbase-standalone-4.3.5.3 [2025-09-09 13:59:53.916] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Call plugin oceanbase-standalone-py_script_obshell_stop-4.2.1.4 for oceanbase-standalone-4.3.5.3-103000112025071821.el7-52082f086d0354a31f32aae2944994587fee2328 [2025-09-09 13:59:53.917] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - import obshell_stop [2025-09-09 13:59:53.917] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - add obshell_stop ref count to 1 [2025-09-09 13:59:53.918] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [INFO] Stop obshell [2025-09-09 13:59:53.918] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- 10.186.56.11 obshell stopping ... [2025-09-09 13:59:53.918] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ls /home/admin/bbcluster/oceanbase/bin/obshell [2025-09-09 13:59:53.992] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:53.992] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cd /home/admin/bbcluster/oceanbase; /home/admin/bbcluster/oceanbase/bin/obshell admin stop [2025-09-09 13:59:55.210] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:55.211] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/obshell.pid [2025-09-09 13:59:55.288] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 1, error output: [2025-09-09 13:59:55.289] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] cat: /home/admin/bbcluster/oceanbase/run/obshell.pid: No such file or directory [2025-09-09 13:59:55.289] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] [2025-09-09 13:59:55.289] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: cat /home/admin/bbcluster/oceanbase/run/daemon.pid [2025-09-09 13:59:55.364] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 0 [2025-09-09 13:59:55.365] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- admin@10.186.56.11 execute: ps uax | egrep " 13931 " | grep -v grep [2025-09-09 13:59:55.464] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] -- exited code 1, error output: [2025-09-09 13:59:55.464] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] [2025-09-09 13:59:55.465] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - sub obshell_stop ref count to 0 [2025-09-09 13:59:55.465] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - export obshell_stop [2025-09-09 13:59:55.465] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - plugin oceanbase-standalone-py_script_obshell_stop-4.2.1.4 result: True [2025-09-09 13:59:55.465] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - Set bbcluster deploy status to stopped [2025-09-09 13:59:55.465] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/bbcluster/.data [2025-09-09 13:59:55.470] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [INFO] bbcluster stopped [2025-09-09 13:59:55.476] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2025-09-09 13:59:55.477] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2025-09-09 13:59:55.477] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2025-09-09 13:59:55.477] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_bbcluster release, count 0 [2025-09-09 13:59:55.477] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - unlock /home/admin/.obd/lock/deploy_bbcluster [2025-09-09 13:59:55.477] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2025-09-09 13:59:55.478] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [DEBUG] - unlock /home/admin/.obd/lock/global [2025-09-09 13:59:55.478] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [INFO] Trace ID: 3376b3cc-8d42-11f0-b1ba-02000aba380b [2025-09-09 13:59:55.478] [3376b3cc-8d42-11f0-b1ba-02000aba380b] [INFO] If you want to view detailed obd logs, please run: obd display-trace 3376b3cc-8d42-11f0-b1ba-02000aba380b