[2024-07-19 10:56:39.014] [DEBUG] - cmd: ['mhsjzt'] [2024-07-19 10:56:39.015] [DEBUG] - opts: {'servers': None, 'components': 'oceanbase-ce', 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2024-07-19 10:56:39.015] [DEBUG] - mkdir /home/admin/.obd/lock/ [2024-07-19 10:56:39.015] [DEBUG] - unknown lock mode [2024-07-19 10:56:39.015] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2024-07-19 10:56:39.015] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2024-07-19 10:56:39.015] [DEBUG] - Get Deploy by name [2024-07-19 10:56:39.016] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2024-07-19 10:56:39.016] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2024-07-19 10:56:39.016] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_mhsjzt [2024-07-19 10:56:39.016] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_mhsjzt`, count 1 [2024-07-19 10:56:39.025] [DEBUG] - Deploy status judge [2024-07-19 10:56:39.026] [INFO] Get local repositories [2024-07-19 10:56:39.027] [DEBUG] - mkdir /home/admin/.obd/repository [2024-07-19 10:56:39.027] [DEBUG] - Get local repository oceanbase-ce-4.2.2.0-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:39.027] [DEBUG] - Search repository oceanbase-ce version: 4.2.2.0, tag: c3ab2f9131720e59921045f93c52256a99301478, release: None, package_hash: None [2024-07-19 10:56:39.027] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2024-07-19 10:56:39.027] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2024-07-19 10:56:39.027] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2024-07-19 10:56:39.030] [DEBUG] - Found repository oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:39.030] [DEBUG] - Get local repository obproxy-ce-4.2.1.0-b0ae6495d2396aafe54c9927f0b9f519be28182d [2024-07-19 10:56:39.030] [DEBUG] - Search repository obproxy-ce version: 4.2.1.0, tag: b0ae6495d2396aafe54c9927f0b9f519be28182d, release: None, package_hash: None [2024-07-19 10:56:39.030] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2024-07-19 10:56:39.031] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2024-07-19 10:56:39.033] [DEBUG] - Found repository obproxy-ce-4.2.1.0-11.el7-b0ae6495d2396aafe54c9927f0b9f519be28182d [2024-07-19 10:56:39.033] [DEBUG] - Get local repository obagent-4.2.2-8a5c3b8c55defe409d1e72b7efd13c5e41549545 [2024-07-19 10:56:39.033] [DEBUG] - Search repository obagent version: 4.2.2, tag: 8a5c3b8c55defe409d1e72b7efd13c5e41549545, release: None, package_hash: None [2024-07-19 10:56:39.033] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2024-07-19 10:56:39.034] [DEBUG] - mkdir /home/admin/.obd/repository/obagent [2024-07-19 10:56:39.036] [DEBUG] - Found repository obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545 [2024-07-19 10:56:39.036] [DEBUG] - Get local repository ocp-express-4.2.2-15f098f450ac4e6e938456f86c34d35a5ee9ae9d [2024-07-19 10:56:39.036] [DEBUG] - Search repository ocp-express version: 4.2.2, tag: 15f098f450ac4e6e938456f86c34d35a5ee9ae9d, release: None, package_hash: None [2024-07-19 10:56:39.036] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2024-07-19 10:56:39.036] [DEBUG] - mkdir /home/admin/.obd/repository/ocp-express [2024-07-19 10:56:39.040] [DEBUG] - Found repository ocp-express-4.2.2-100000022024011120.el7-15f098f450ac4e6e938456f86c34d35a5ee9ae9d [2024-07-19 10:56:39.157] [DEBUG] - Get deploy config [2024-07-19 10:56:39.216] [INFO] Search plugins [2024-07-19 10:56:39.217] [DEBUG] - Searching start_check plugin for components ... [2024-07-19 10:56:39.217] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:39.217] [DEBUG] - mkdir /home/admin/.obd/plugins [2024-07-19 10:56:39.218] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.2.2.0 for oceanbase-ce-4.2.2.0 [2024-07-19 10:56:39.218] [DEBUG] - Searching start_check plugin for obproxy-ce-4.2.1.0-11.el7-b0ae6495d2396aafe54c9927f0b9f519be28182d [2024-07-19 10:56:39.218] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.2.1.0 [2024-07-19 10:56:39.218] [DEBUG] - Searching start_check plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545 [2024-07-19 10:56:39.219] [DEBUG] - Found for obagent-py_script_start_check-1.3.0 for obagent-4.2.2 [2024-07-19 10:56:39.219] [DEBUG] - Searching start_check plugin for ocp-express-4.2.2-100000022024011120.el7-15f098f450ac4e6e938456f86c34d35a5ee9ae9d [2024-07-19 10:56:39.219] [DEBUG] - Found for ocp-express-py_script_start_check-4.2.1 for ocp-express-4.2.2 [2024-07-19 10:56:39.219] [DEBUG] - Searching create_tenant plugin for components ... [2024-07-19 10:56:39.219] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:39.220] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.2.0.0 for oceanbase-ce-4.2.2.0 [2024-07-19 10:56:39.220] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.2.1.0-11.el7-b0ae6495d2396aafe54c9927f0b9f519be28182d [2024-07-19 10:56:39.220] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.2.1.0 [2024-07-19 10:56:39.220] [DEBUG] - Searching create_tenant plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545 [2024-07-19 10:56:39.221] [DEBUG] - No such create_tenant plugin for obagent-4.2.2 [2024-07-19 10:56:39.221] [DEBUG] - Searching create_tenant plugin for ocp-express-4.2.2-100000022024011120.el7-15f098f450ac4e6e938456f86c34d35a5ee9ae9d [2024-07-19 10:56:39.221] [DEBUG] - No such create_tenant plugin for ocp-express-4.2.2 [2024-07-19 10:56:39.221] [DEBUG] - Searching start plugin for components ... [2024-07-19 10:56:39.221] [DEBUG] - Searching start plugin for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:39.222] [DEBUG] - Found for oceanbase-ce-py_script_start-4.2.2.0 for oceanbase-ce-4.2.2.0 [2024-07-19 10:56:39.222] [DEBUG] - Searching start plugin for obproxy-ce-4.2.1.0-11.el7-b0ae6495d2396aafe54c9927f0b9f519be28182d [2024-07-19 10:56:39.222] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.2.1.0 [2024-07-19 10:56:39.222] [DEBUG] - Searching start plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545 [2024-07-19 10:56:39.222] [DEBUG] - Found for obagent-py_script_start-1.3.0 for obagent-4.2.2 [2024-07-19 10:56:39.223] [DEBUG] - Searching start plugin for ocp-express-4.2.2-100000022024011120.el7-15f098f450ac4e6e938456f86c34d35a5ee9ae9d [2024-07-19 10:56:39.223] [DEBUG] - Found for ocp-express-py_script_start-4.2.1 for ocp-express-4.2.2 [2024-07-19 10:56:39.223] [DEBUG] - Searching connect plugin for components ... [2024-07-19 10:56:39.223] [DEBUG] - Searching connect plugin for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:39.224] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.2.2.0 [2024-07-19 10:56:39.224] [DEBUG] - Searching connect plugin for obproxy-ce-4.2.1.0-11.el7-b0ae6495d2396aafe54c9927f0b9f519be28182d [2024-07-19 10:56:39.224] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.1.0 [2024-07-19 10:56:39.224] [DEBUG] - Searching connect plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545 [2024-07-19 10:56:39.224] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-4.2.2 [2024-07-19 10:56:39.224] [DEBUG] - Searching connect plugin for ocp-express-4.2.2-100000022024011120.el7-15f098f450ac4e6e938456f86c34d35a5ee9ae9d [2024-07-19 10:56:39.225] [DEBUG] - Found for ocp-express-py_script_connect-1.0.1 for ocp-express-4.2.2 [2024-07-19 10:56:39.225] [DEBUG] - Searching bootstrap plugin for components ... [2024-07-19 10:56:39.225] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:39.225] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.2.2.0 for oceanbase-ce-4.2.2.0 [2024-07-19 10:56:39.226] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.2.1.0-11.el7-b0ae6495d2396aafe54c9927f0b9f519be28182d [2024-07-19 10:56:39.226] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.2.1.0 [2024-07-19 10:56:39.226] [DEBUG] - Searching bootstrap plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545 [2024-07-19 10:56:39.226] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-4.2.2 [2024-07-19 10:56:39.226] [DEBUG] - Searching bootstrap plugin for ocp-express-4.2.2-100000022024011120.el7-15f098f450ac4e6e938456f86c34d35a5ee9ae9d [2024-07-19 10:56:39.227] [DEBUG] - Found for ocp-express-py_script_bootstrap-1.0.1 for ocp-express-4.2.2 [2024-07-19 10:56:39.227] [DEBUG] - Searching display plugin for components ... [2024-07-19 10:56:39.227] [DEBUG] - Searching display plugin for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:39.227] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.2.0 [2024-07-19 10:56:39.227] [DEBUG] - Searching display plugin for obproxy-ce-4.2.1.0-11.el7-b0ae6495d2396aafe54c9927f0b9f519be28182d [2024-07-19 10:56:39.228] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.1.0 [2024-07-19 10:56:39.228] [DEBUG] - Searching display plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545 [2024-07-19 10:56:39.228] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-4.2.2 [2024-07-19 10:56:39.228] [DEBUG] - Searching display plugin for ocp-express-4.2.2-100000022024011120.el7-15f098f450ac4e6e938456f86c34d35a5ee9ae9d [2024-07-19 10:56:39.228] [DEBUG] - Found for ocp-express-py_script_display-1.0.1 for ocp-express-4.2.2 [2024-07-19 10:56:39.347] [INFO] Load cluster param plugin [2024-07-19 10:56:39.348] [DEBUG] - Get local repository oceanbase-ce-4.2.2.0-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:39.348] [DEBUG] - Get local repository obproxy-ce-4.2.1.0-b0ae6495d2396aafe54c9927f0b9f519be28182d [2024-07-19 10:56:39.348] [DEBUG] - Get local repository obagent-4.2.2-8a5c3b8c55defe409d1e72b7efd13c5e41549545 [2024-07-19 10:56:39.348] [DEBUG] - Get local repository ocp-express-4.2.2-15f098f450ac4e6e938456f86c34d35a5ee9ae9d [2024-07-19 10:56:39.348] [DEBUG] - Searching param plugin for components ... [2024-07-19 10:56:39.348] [DEBUG] - Search param plugin for oceanbase-ce [2024-07-19 10:56:39.349] [DEBUG] - Found for oceanbase-ce-param-4.2.2.0 for oceanbase-ce-4.2.2.0 [2024-07-19 10:56:39.349] [DEBUG] - Applying oceanbase-ce-param-4.2.2.0 for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:40.105] [DEBUG] - Search param plugin for obproxy-ce [2024-07-19 10:56:40.105] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.2.1.0 [2024-07-19 10:56:40.105] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.2.1.0-11.el7-b0ae6495d2396aafe54c9927f0b9f519be28182d [2024-07-19 10:56:40.286] [DEBUG] - Search param plugin for obagent [2024-07-19 10:56:40.287] [DEBUG] - Found for obagent-param-1.3.0 for obagent-4.2.2 [2024-07-19 10:56:40.287] [DEBUG] - Applying obagent-param-1.3.0 for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545 [2024-07-19 10:56:40.377] [DEBUG] - Search param plugin for ocp-express [2024-07-19 10:56:40.378] [DEBUG] - Found for ocp-express-param-4.1.0 for ocp-express-4.2.2 [2024-07-19 10:56:40.378] [DEBUG] - Applying ocp-express-param-4.1.0 for ocp-express-4.2.2-100000022024011120.el7-15f098f450ac4e6e938456f86c34d35a5ee9ae9d [2024-07-19 10:56:40.513] [INFO] Open ssh connection [2024-07-19 10:56:40.514] [DEBUG] - host: 172.20.10.9, port: 22, user: admin, password: None [2024-07-19 10:56:40.799] [DEBUG] - host: 172.20.10.4, port: 22, user: admin, password: None [2024-07-19 10:56:41.082] [DEBUG] - host: 172.20.10.6, port: 22, user: admin, password: None [2024-07-19 10:56:41.368] [DEBUG] - host: 172.20.10.7, port: 22, user: admin, password: None [2024-07-19 10:56:41.652] [DEBUG] - host: 172.20.10.10, port: 22, user: admin, password: None [2024-07-19 10:56:41.936] [DEBUG] - host: 172.20.10.9, port: 22, user: admin, password: None [2024-07-19 10:56:42.222] [DEBUG] - host: 172.20.10.8, port: 22, user: admin, password: None [2024-07-19 10:56:42.506] [DEBUG] - host: 172.20.10.5, port: 22, user: admin, password: None [2024-07-19 10:56:42.790] [DEBUG] - host: 172.20.10.7, port: 22, user: admin, password: None [2024-07-19 10:56:43.074] [DEBUG] - host: 172.20.10.5, port: 22, user: admin, password: None [2024-07-19 10:56:43.465] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.2.2.0 for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:43.465] [DEBUG] - import start_check [2024-07-19 10:56:43.473] [DEBUG] - add start_check ref count to 1 [2024-07-19 10:56:43.474] [INFO] Check before start observer [2024-07-19 10:56:43.479] [DEBUG] -- admin@172.20.10.5 execute: ls /data/clog/tenant_1/ [2024-07-19 10:56:43.536] [DEBUG] -- exited code 0 [2024-07-19 10:56:43.537] [DEBUG] -- admin@172.20.10.5 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:43.636] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:43.636] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:43.636] [DEBUG] [2024-07-19 10:56:43.637] [DEBUG] -- server1(172.20.10.5) port check [2024-07-19 10:56:43.637] [DEBUG] -- admin@172.20.10.5 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:43.798] [DEBUG] -- exited code 0 [2024-07-19 10:56:43.798] [DEBUG] -- admin@172.20.10.5 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:43.957] [DEBUG] -- exited code 0 [2024-07-19 10:56:43.958] [DEBUG] -- admin@172.20.10.5 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '050A14AC:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:44.117] [DEBUG] -- exited code 0 [2024-07-19 10:56:44.118] [DEBUG] -- admin@172.20.10.5 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:44.273] [DEBUG] -- exited code 0 [2024-07-19 10:56:44.274] [DEBUG] -- admin@172.20.10.5 execute: ls /data/sstable/block_file [2024-07-19 10:56:44.374] [DEBUG] -- exited code 0 [2024-07-19 10:56:44.379] [DEBUG] -- admin@172.20.10.6 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:44.433] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:44.433] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:44.433] [DEBUG] [2024-07-19 10:56:44.433] [DEBUG] -- server2(172.20.10.6) port check [2024-07-19 10:56:44.433] [DEBUG] -- admin@172.20.10.6 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:44.592] [DEBUG] -- exited code 0 [2024-07-19 10:56:44.593] [DEBUG] -- admin@172.20.10.6 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:44.743] [DEBUG] -- exited code 0 [2024-07-19 10:56:44.744] [DEBUG] -- admin@172.20.10.6 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '060A14AC:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:44.902] [DEBUG] -- exited code 0 [2024-07-19 10:56:44.903] [DEBUG] -- admin@172.20.10.6 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:45.053] [DEBUG] -- exited code 0 [2024-07-19 10:56:45.053] [DEBUG] -- admin@172.20.10.6 execute: ls /data/sstable/block_file [2024-07-19 10:56:45.155] [DEBUG] -- exited code 0 [2024-07-19 10:56:45.160] [DEBUG] -- admin@172.20.10.7 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:45.217] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:45.217] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:45.217] [DEBUG] [2024-07-19 10:56:45.217] [DEBUG] -- server3(172.20.10.7) port check [2024-07-19 10:56:45.217] [DEBUG] -- admin@172.20.10.7 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:45.377] [DEBUG] -- exited code 0 [2024-07-19 10:56:45.377] [DEBUG] -- admin@172.20.10.7 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:45.535] [DEBUG] -- exited code 0 [2024-07-19 10:56:45.535] [DEBUG] -- admin@172.20.10.7 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '070A14AC:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:45.697] [DEBUG] -- exited code 0 [2024-07-19 10:56:45.697] [DEBUG] -- admin@172.20.10.7 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:45.854] [DEBUG] -- exited code 0 [2024-07-19 10:56:45.855] [DEBUG] -- admin@172.20.10.7 execute: ls /data/sstable/block_file [2024-07-19 10:56:45.966] [DEBUG] -- exited code 0 [2024-07-19 10:56:45.971] [DEBUG] -- admin@172.20.10.8 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:46.025] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:46.025] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:46.025] [DEBUG] [2024-07-19 10:56:46.025] [DEBUG] -- server4(172.20.10.8) port check [2024-07-19 10:56:46.025] [DEBUG] -- admin@172.20.10.8 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:46.182] [DEBUG] -- exited code 0 [2024-07-19 10:56:46.182] [DEBUG] -- admin@172.20.10.8 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:46.342] [DEBUG] -- exited code 0 [2024-07-19 10:56:46.342] [DEBUG] -- admin@172.20.10.8 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '080A14AC:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:46.502] [DEBUG] -- exited code 0 [2024-07-19 10:56:46.503] [DEBUG] -- admin@172.20.10.8 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:46.664] [DEBUG] -- exited code 0 [2024-07-19 10:56:46.664] [DEBUG] -- admin@172.20.10.8 execute: ls /data/sstable/block_file [2024-07-19 10:56:46.765] [DEBUG] -- exited code 0 [2024-07-19 10:56:46.770] [DEBUG] -- admin@172.20.10.9 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:46.824] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:46.824] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:46.824] [DEBUG] [2024-07-19 10:56:46.825] [DEBUG] -- server5(172.20.10.9) port check [2024-07-19 10:56:46.825] [DEBUG] -- admin@172.20.10.9 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:46.977] [DEBUG] -- exited code 0 [2024-07-19 10:56:46.977] [DEBUG] -- admin@172.20.10.9 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:47.147] [DEBUG] -- exited code 0 [2024-07-19 10:56:47.148] [DEBUG] -- admin@172.20.10.9 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '090A14AC:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:47.307] [DEBUG] -- exited code 0 [2024-07-19 10:56:47.307] [DEBUG] -- admin@172.20.10.9 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:47.471] [DEBUG] -- exited code 0 [2024-07-19 10:56:47.471] [DEBUG] -- admin@172.20.10.9 execute: ls /data/sstable/block_file [2024-07-19 10:56:47.570] [DEBUG] -- exited code 0 [2024-07-19 10:56:47.575] [DEBUG] -- admin@172.20.10.10 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:47.629] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:47.629] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:47.629] [DEBUG] [2024-07-19 10:56:47.629] [DEBUG] -- server6(172.20.10.10) port check [2024-07-19 10:56:47.629] [DEBUG] -- admin@172.20.10.10 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:47.785] [DEBUG] -- exited code 0 [2024-07-19 10:56:47.785] [DEBUG] -- admin@172.20.10.10 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:47.945] [DEBUG] -- exited code 0 [2024-07-19 10:56:47.945] [DEBUG] -- admin@172.20.10.10 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '0A0A14AC:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:48.104] [DEBUG] -- exited code 0 [2024-07-19 10:56:48.104] [DEBUG] -- admin@172.20.10.10 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B46' | awk -F' ' '{print $2}' | uniq [2024-07-19 10:56:48.263] [DEBUG] -- exited code 0 [2024-07-19 10:56:48.264] [DEBUG] -- admin@172.20.10.10 execute: ls /data/sstable/block_file [2024-07-19 10:56:48.365] [DEBUG] -- exited code 0 [2024-07-19 10:56:48.365] [DEBUG] -- admin@172.20.10.10 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ] [2024-07-19 10:56:48.464] [DEBUG] -- exited code 0 [2024-07-19 10:56:48.465] [DEBUG] -- admin@172.20.10.5 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-07-19 10:56:48.521] [DEBUG] -- exited code 0 [2024-07-19 10:56:48.521] [DEBUG] -- admin@172.20.10.5 execute: ulimit -a [2024-07-19 10:56:48.636] [DEBUG] -- exited code 0 [2024-07-19 10:56:48.637] [DEBUG] -- admin@172.20.10.5 execute: sysctl -a [2024-07-19 10:56:48.767] [DEBUG] -- exited code 0 [2024-07-19 10:56:48.776] [DEBUG] -- admin@172.20.10.5 execute: cat /proc/meminfo [2024-07-19 10:56:48.862] [DEBUG] -- exited code 0 [2024-07-19 10:56:48.863] [DEBUG] -- admin@172.20.10.5 execute: df --block-size=1024 [2024-07-19 10:56:48.962] [DEBUG] -- exited code 0 [2024-07-19 10:56:48.963] [DEBUG] -- get disk info for path /dev, total: 68168056832 avail: 68168056832 [2024-07-19 10:56:48.963] [DEBUG] -- get disk info for path /dev/shm, total: 68453072896 avail: 68452745216 [2024-07-19 10:56:48.963] [DEBUG] -- get disk info for path /run, total: 68453072896 avail: 64172392448 [2024-07-19 10:56:48.963] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 68453072896 avail: 68453072896 [2024-07-19 10:56:48.963] [DEBUG] -- get disk info for path /, total: 107142533120 avail: 49307701248 [2024-07-19 10:56:48.964] [DEBUG] -- get disk info for path /tmp, total: 68453072896 avail: 68452876288 [2024-07-19 10:56:48.964] [DEBUG] -- get disk info for path /boot/efi, total: 209489920 avail: 203501568 [2024-07-19 10:56:48.964] [DEBUG] -- get disk info for path /data, total: 3799510761472 avail: 360182833152 [2024-07-19 10:56:48.964] [DEBUG] -- get disk info for path /redo, total: 527369166848 avail: 50000691200 [2024-07-19 10:56:48.964] [DEBUG] -- get disk info for path /run/user/0, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:48.964] [DEBUG] -- get disk info for path /run/user/1004, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:48.964] [DEBUG] -- disk: {'/dev': {'total': 68168056832, 'avail': 68168056832, 'need': 0}, '/dev/shm': {'total': 68453072896, 'avail': 68452745216, 'need': 0}, '/run': {'total': 68453072896, 'avail': 64172392448, 'need': 0}, '/sys/fs/cgroup': {'total': 68453072896, 'avail': 68453072896, 'need': 0}, '/': {'total': 107142533120, 'avail': 49307701248, 'need': 0}, '/tmp': {'total': 68453072896, 'avail': 68452876288, 'need': 0}, '/boot/efi': {'total': 209489920, 'avail': 203501568, 'need': 0}, '/data': {'total': 3799510761472, 'avail': 360182833152, 'need': 0}, '/redo': {'total': 527369166848, 'avail': 50000691200, 'need': 0}, '/run/user/0': {'total': 13690601472, 'avail': 13690601472, 'need': 0}, '/run/user/1004': {'total': 13690601472, 'avail': 13690601472, 'need': 0}} [2024-07-19 10:56:48.964] [DEBUG] -- admin@172.20.10.5 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ] [2024-07-19 10:56:49.073] [DEBUG] -- exited code 0 [2024-07-19 10:56:49.074] [DEBUG] -- admin@172.20.10.6 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-07-19 10:56:49.127] [DEBUG] -- exited code 0 [2024-07-19 10:56:49.128] [DEBUG] -- admin@172.20.10.6 execute: ulimit -a [2024-07-19 10:56:49.224] [DEBUG] -- exited code 0 [2024-07-19 10:56:49.224] [DEBUG] -- admin@172.20.10.6 execute: sysctl -a [2024-07-19 10:56:49.355] [DEBUG] -- exited code 0 [2024-07-19 10:56:49.364] [DEBUG] -- admin@172.20.10.6 execute: cat /proc/meminfo [2024-07-19 10:56:49.455] [DEBUG] -- exited code 0 [2024-07-19 10:56:49.456] [DEBUG] -- admin@172.20.10.6 execute: df --block-size=1024 [2024-07-19 10:56:49.555] [DEBUG] -- exited code 0 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /dev, total: 68168056832 avail: 68168056832 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /dev/shm, total: 68453072896 avail: 68452745216 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /run, total: 68453072896 avail: 64122322944 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 68453072896 avail: 68453072896 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /, total: 107142533120 avail: 96931037184 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /tmp, total: 68453072896 avail: 68452876288 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /boot/efi, total: 209489920 avail: 203501568 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /redo, total: 527369166848 avail: 50000691200 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /data, total: 3799510761472 avail: 360130134016 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /run/user/0, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:49.556] [DEBUG] -- get disk info for path /run/user/1004, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:49.557] [DEBUG] -- disk: {'/dev': {'total': 68168056832, 'avail': 68168056832, 'need': 0}, '/dev/shm': {'total': 68453072896, 'avail': 68452745216, 'need': 0}, '/run': {'total': 68453072896, 'avail': 64122322944, 'need': 0}, '/sys/fs/cgroup': {'total': 68453072896, 'avail': 68453072896, 'need': 0}, '/': {'total': 107142533120, 'avail': 96931037184, 'need': 0}, '/tmp': {'total': 68453072896, 'avail': 68452876288, 'need': 0}, '/boot/efi': {'total': 209489920, 'avail': 203501568, 'need': 0}, '/redo': {'total': 527369166848, 'avail': 50000691200, 'need': 0}, '/data': {'total': 3799510761472, 'avail': 360130134016, 'need': 0}, '/run/user/0': {'total': 13690601472, 'avail': 13690601472, 'need': 0}, '/run/user/1004': {'total': 13690601472, 'avail': 13690601472, 'need': 0}} [2024-07-19 10:56:49.557] [DEBUG] -- admin@172.20.10.6 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ] [2024-07-19 10:56:49.654] [DEBUG] -- exited code 0 [2024-07-19 10:56:49.655] [DEBUG] -- admin@172.20.10.7 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-07-19 10:56:49.711] [DEBUG] -- exited code 0 [2024-07-19 10:56:49.711] [DEBUG] -- admin@172.20.10.7 execute: ulimit -a [2024-07-19 10:56:49.804] [DEBUG] -- exited code 0 [2024-07-19 10:56:49.804] [DEBUG] -- admin@172.20.10.7 execute: sysctl -a [2024-07-19 10:56:49.945] [DEBUG] -- exited code 0 [2024-07-19 10:56:49.954] [DEBUG] -- admin@172.20.10.7 execute: cat /proc/meminfo [2024-07-19 10:56:50.044] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.045] [DEBUG] -- admin@172.20.10.7 execute: df --block-size=1024 [2024-07-19 10:56:50.144] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.145] [DEBUG] -- get disk info for path /dev, total: 68168056832 avail: 68168056832 [2024-07-19 10:56:50.145] [DEBUG] -- get disk info for path /dev/shm, total: 68453072896 avail: 68452745216 [2024-07-19 10:56:50.145] [DEBUG] -- get disk info for path /run, total: 68453072896 avail: 64055083008 [2024-07-19 10:56:50.145] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 68453072896 avail: 68453072896 [2024-07-19 10:56:50.145] [DEBUG] -- get disk info for path /, total: 107142533120 avail: 95483613184 [2024-07-19 10:56:50.145] [DEBUG] -- get disk info for path /tmp, total: 68453072896 avail: 68452876288 [2024-07-19 10:56:50.146] [DEBUG] -- get disk info for path /boot/efi, total: 209489920 avail: 203501568 [2024-07-19 10:56:50.146] [DEBUG] -- get disk info for path /redo, total: 527369166848 avail: 50000691200 [2024-07-19 10:56:50.146] [DEBUG] -- get disk info for path /data, total: 3799510761472 avail: 360184913920 [2024-07-19 10:56:50.146] [DEBUG] -- get disk info for path /run/user/0, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:50.146] [DEBUG] -- get disk info for path /run/user/1004, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:50.146] [DEBUG] -- disk: {'/dev': {'total': 68168056832, 'avail': 68168056832, 'need': 0}, '/dev/shm': {'total': 68453072896, 'avail': 68452745216, 'need': 0}, '/run': {'total': 68453072896, 'avail': 64055083008, 'need': 0}, '/sys/fs/cgroup': {'total': 68453072896, 'avail': 68453072896, 'need': 0}, '/': {'total': 107142533120, 'avail': 95483613184, 'need': 0}, '/tmp': {'total': 68453072896, 'avail': 68452876288, 'need': 0}, '/boot/efi': {'total': 209489920, 'avail': 203501568, 'need': 0}, '/redo': {'total': 527369166848, 'avail': 50000691200, 'need': 0}, '/data': {'total': 3799510761472, 'avail': 360184913920, 'need': 0}, '/run/user/0': {'total': 13690601472, 'avail': 13690601472, 'need': 0}, '/run/user/1004': {'total': 13690601472, 'avail': 13690601472, 'need': 0}} [2024-07-19 10:56:50.146] [DEBUG] -- admin@172.20.10.7 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ] [2024-07-19 10:56:50.244] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.245] [DEBUG] -- admin@172.20.10.8 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-07-19 10:56:50.298] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.299] [DEBUG] -- admin@172.20.10.8 execute: ulimit -a [2024-07-19 10:56:50.393] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.394] [DEBUG] -- admin@172.20.10.8 execute: sysctl -a [2024-07-19 10:56:50.525] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.534] [DEBUG] -- admin@172.20.10.8 execute: cat /proc/meminfo [2024-07-19 10:56:50.625] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.625] [DEBUG] -- admin@172.20.10.8 execute: df --block-size=1024 [2024-07-19 10:56:50.724] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /dev, total: 68168056832 avail: 68168056832 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /dev/shm, total: 68453072896 avail: 68452745216 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /run, total: 68453072896 avail: 64147488768 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 68453072896 avail: 68453072896 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /, total: 107142533120 avail: 97527173120 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /tmp, total: 68453072896 avail: 68452876288 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /boot/efi, total: 209489920 avail: 203501568 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /redo, total: 527369166848 avail: 50000691200 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /data, total: 3799510761472 avail: 360171331584 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /run/user/0, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:50.725] [DEBUG] -- get disk info for path /run/user/1004, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:50.725] [DEBUG] -- disk: {'/dev': {'total': 68168056832, 'avail': 68168056832, 'need': 0}, '/dev/shm': {'total': 68453072896, 'avail': 68452745216, 'need': 0}, '/run': {'total': 68453072896, 'avail': 64147488768, 'need': 0}, '/sys/fs/cgroup': {'total': 68453072896, 'avail': 68453072896, 'need': 0}, '/': {'total': 107142533120, 'avail': 97527173120, 'need': 0}, '/tmp': {'total': 68453072896, 'avail': 68452876288, 'need': 0}, '/boot/efi': {'total': 209489920, 'avail': 203501568, 'need': 0}, '/redo': {'total': 527369166848, 'avail': 50000691200, 'need': 0}, '/data': {'total': 3799510761472, 'avail': 360171331584, 'need': 0}, '/run/user/0': {'total': 13690601472, 'avail': 13690601472, 'need': 0}, '/run/user/1004': {'total': 13690601472, 'avail': 13690601472, 'need': 0}} [2024-07-19 10:56:50.726] [DEBUG] -- admin@172.20.10.8 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ] [2024-07-19 10:56:50.833] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.833] [DEBUG] -- admin@172.20.10.9 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-07-19 10:56:50.886] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.887] [DEBUG] -- admin@172.20.10.9 execute: ulimit -a [2024-07-19 10:56:50.981] [DEBUG] -- exited code 0 [2024-07-19 10:56:50.981] [DEBUG] -- admin@172.20.10.9 execute: sysctl -a [2024-07-19 10:56:51.114] [DEBUG] -- exited code 0 [2024-07-19 10:56:51.123] [DEBUG] -- admin@172.20.10.9 execute: cat /proc/meminfo [2024-07-19 10:56:51.210] [DEBUG] -- exited code 0 [2024-07-19 10:56:51.211] [DEBUG] -- admin@172.20.10.9 execute: df --block-size=1024 [2024-07-19 10:56:51.319] [DEBUG] -- exited code 0 [2024-07-19 10:56:51.320] [DEBUG] -- get disk info for path /dev, total: 68168056832 avail: 68168056832 [2024-07-19 10:56:51.320] [DEBUG] -- get disk info for path /dev/shm, total: 68453072896 avail: 68452745216 [2024-07-19 10:56:51.320] [DEBUG] -- get disk info for path /run, total: 68453072896 avail: 64147357696 [2024-07-19 10:56:51.320] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 68453072896 avail: 68453072896 [2024-07-19 10:56:51.320] [DEBUG] -- get disk info for path /, total: 107142533120 avail: 96197222400 [2024-07-19 10:56:51.320] [DEBUG] -- get disk info for path /tmp, total: 68453072896 avail: 68452876288 [2024-07-19 10:56:51.320] [DEBUG] -- get disk info for path /boot/efi, total: 209489920 avail: 203501568 [2024-07-19 10:56:51.320] [DEBUG] -- get disk info for path /redo, total: 527369166848 avail: 50015404032 [2024-07-19 10:56:51.320] [DEBUG] -- get disk info for path /data, total: 3799510761472 avail: 360173039616 [2024-07-19 10:56:51.321] [DEBUG] -- get disk info for path /run/user/0, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:51.321] [DEBUG] -- get disk info for path /run/user/1004, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:51.321] [DEBUG] -- disk: {'/dev': {'total': 68168056832, 'avail': 68168056832, 'need': 0}, '/dev/shm': {'total': 68453072896, 'avail': 68452745216, 'need': 0}, '/run': {'total': 68453072896, 'avail': 64147357696, 'need': 0}, '/sys/fs/cgroup': {'total': 68453072896, 'avail': 68453072896, 'need': 0}, '/': {'total': 107142533120, 'avail': 96197222400, 'need': 0}, '/tmp': {'total': 68453072896, 'avail': 68452876288, 'need': 0}, '/boot/efi': {'total': 209489920, 'avail': 203501568, 'need': 0}, '/redo': {'total': 527369166848, 'avail': 50015404032, 'need': 0}, '/data': {'total': 3799510761472, 'avail': 360173039616, 'need': 0}, '/run/user/0': {'total': 13690601472, 'avail': 13690601472, 'need': 0}, '/run/user/1004': {'total': 13690601472, 'avail': 13690601472, 'need': 0}} [2024-07-19 10:56:51.321] [DEBUG] -- admin@172.20.10.9 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ] [2024-07-19 10:56:51.417] [DEBUG] -- exited code 0 [2024-07-19 10:56:51.418] [DEBUG] -- admin@172.20.10.10 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-07-19 10:56:51.473] [DEBUG] -- exited code 0 [2024-07-19 10:56:51.473] [DEBUG] -- admin@172.20.10.10 execute: ulimit -a [2024-07-19 10:56:51.574] [DEBUG] -- exited code 0 [2024-07-19 10:56:51.575] [DEBUG] -- admin@172.20.10.10 execute: sysctl -a [2024-07-19 10:56:51.707] [DEBUG] -- exited code 0 [2024-07-19 10:56:51.715] [DEBUG] -- admin@172.20.10.10 execute: cat /proc/meminfo [2024-07-19 10:56:51.805] [DEBUG] -- exited code 0 [2024-07-19 10:56:51.805] [DEBUG] -- admin@172.20.10.10 execute: df --block-size=1024 [2024-07-19 10:56:51.905] [DEBUG] -- exited code 0 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /dev, total: 68168056832 avail: 68168056832 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /dev/shm, total: 68453072896 avail: 68452745216 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /run, total: 68453072896 avail: 64181043200 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 68453072896 avail: 68453072896 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /, total: 107142533120 avail: 97305018368 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /tmp, total: 68453072896 avail: 68452876288 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /boot/efi, total: 209489920 avail: 203501568 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /redo, total: 527369166848 avail: 50041528320 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /data, total: 3799510761472 avail: 360155987968 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /run/user/0, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:51.906] [DEBUG] -- get disk info for path /run/user/1004, total: 13690601472 avail: 13690601472 [2024-07-19 10:56:51.906] [DEBUG] -- disk: {'/dev': {'total': 68168056832, 'avail': 68168056832, 'need': 0}, '/dev/shm': {'total': 68453072896, 'avail': 68452745216, 'need': 0}, '/run': {'total': 68453072896, 'avail': 64181043200, 'need': 0}, '/sys/fs/cgroup': {'total': 68453072896, 'avail': 68453072896, 'need': 0}, '/': {'total': 107142533120, 'avail': 97305018368, 'need': 0}, '/tmp': {'total': 68453072896, 'avail': 68452876288, 'need': 0}, '/boot/efi': {'total': 209489920, 'avail': 203501568, 'need': 0}, '/redo': {'total': 527369166848, 'avail': 50041528320, 'need': 0}, '/data': {'total': 3799510761472, 'avail': 360155987968, 'need': 0}, '/run/user/0': {'total': 13690601472, 'avail': 13690601472, 'need': 0}, '/run/user/1004': {'total': 13690601472, 'avail': 13690601472, 'need': 0}} [2024-07-19 10:56:51.907] [DEBUG] -- admin@172.20.10.5 execute: date +%s%N [2024-07-19 10:56:51.963] [DEBUG] -- exited code 0 [2024-07-19 10:56:51.963] [DEBUG] -- 172.20.10.5 time delta -1.405029296875 [2024-07-19 10:56:51.963] [DEBUG] -- admin@172.20.10.6 execute: date +%s%N [2024-07-19 10:56:52.017] [DEBUG] -- exited code 0 [2024-07-19 10:56:52.018] [DEBUG] -- 172.20.10.6 time delta -1.115966796875 [2024-07-19 10:56:52.018] [DEBUG] -- admin@172.20.10.7 execute: date +%s%N [2024-07-19 10:56:52.074] [DEBUG] -- exited code 0 [2024-07-19 10:56:52.074] [DEBUG] -- 172.20.10.7 time delta -1.331298828125 [2024-07-19 10:56:52.074] [DEBUG] -- admin@172.20.10.8 execute: date +%s%N [2024-07-19 10:56:52.127] [DEBUG] -- exited code 0 [2024-07-19 10:56:52.128] [DEBUG] -- 172.20.10.8 time delta -1.155029296875 [2024-07-19 10:56:52.128] [DEBUG] -- admin@172.20.10.9 execute: date +%s%N [2024-07-19 10:56:52.182] [DEBUG] -- exited code 0 [2024-07-19 10:56:52.182] [DEBUG] -- 172.20.10.9 time delta -1.50830078125 [2024-07-19 10:56:52.182] [DEBUG] -- admin@172.20.10.10 execute: date +%s%N [2024-07-19 10:56:52.236] [DEBUG] -- exited code 0 [2024-07-19 10:56:52.236] [DEBUG] -- 172.20.10.10 time delta -1.076904296875 [2024-07-19 10:56:52.338] [DEBUG] - sub start_check ref count to 0 [2024-07-19 10:56:52.338] [DEBUG] - export start_check [2024-07-19 10:56:52.338] [DEBUG] - Call oceanbase-ce-py_script_start-4.2.2.0 for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:56:52.338] [DEBUG] - import start [2024-07-19 10:56:52.341] [DEBUG] - add start ref count to 1 [2024-07-19 10:56:52.341] [INFO] Start observer [2024-07-19 10:56:52.342] [DEBUG] -- admin@172.20.10.5 execute: ls /data/clog/tenant_1/ [2024-07-19 10:56:52.395] [DEBUG] -- exited code 0 [2024-07-19 10:56:52.396] [DEBUG] -- admin@172.20.10.5 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:52.492] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:52.492] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:52.492] [DEBUG] [2024-07-19 10:56:52.493] [DEBUG] -- server1(172.20.10.5) start command construction [2024-07-19 10:56:52.493] [DEBUG] -- admin@172.20.10.6 execute: ls /data/clog/tenant_1/ [2024-07-19 10:56:52.546] [DEBUG] -- exited code 0 [2024-07-19 10:56:52.546] [DEBUG] -- admin@172.20.10.6 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:52.644] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:52.644] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:52.645] [DEBUG] [2024-07-19 10:56:52.645] [DEBUG] -- server2(172.20.10.6) start command construction [2024-07-19 10:56:52.645] [DEBUG] -- admin@172.20.10.7 execute: ls /data/clog/tenant_1/ [2024-07-19 10:56:52.700] [DEBUG] -- exited code 0 [2024-07-19 10:56:52.700] [DEBUG] -- admin@172.20.10.7 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:52.795] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:52.795] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:52.795] [DEBUG] [2024-07-19 10:56:52.795] [DEBUG] -- server3(172.20.10.7) start command construction [2024-07-19 10:56:52.795] [DEBUG] -- admin@172.20.10.8 execute: ls /data/clog/tenant_1/ [2024-07-19 10:56:52.850] [DEBUG] -- exited code 0 [2024-07-19 10:56:52.850] [DEBUG] -- admin@172.20.10.8 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:52.954] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:52.954] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:52.954] [DEBUG] [2024-07-19 10:56:52.954] [DEBUG] -- server4(172.20.10.8) start command construction [2024-07-19 10:56:52.954] [DEBUG] -- admin@172.20.10.9 execute: ls /data/clog/tenant_1/ [2024-07-19 10:56:53.009] [DEBUG] -- exited code 0 [2024-07-19 10:56:53.009] [DEBUG] -- admin@172.20.10.9 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:53.109] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:53.109] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:53.109] [DEBUG] [2024-07-19 10:56:53.110] [DEBUG] -- server5(172.20.10.9) start command construction [2024-07-19 10:56:53.110] [DEBUG] -- admin@172.20.10.10 execute: ls /data/clog/tenant_1/ [2024-07-19 10:56:53.165] [DEBUG] -- exited code 0 [2024-07-19 10:56:53.165] [DEBUG] -- admin@172.20.10.10 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:56:53.263] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:53.263] [DEBUG] cat: /home/admin/observer/run/observer.pid: No such file or directory [2024-07-19 10:56:53.263] [DEBUG] [2024-07-19 10:56:53.263] [DEBUG] -- server6(172.20.10.10) start command construction [2024-07-19 10:56:53.263] [DEBUG] -- starting server1(172.20.10.5) observer [2024-07-19 10:56:53.264] [DEBUG] -- admin@172.20.10.5 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2024-07-19 10:56:53.264] [DEBUG] -- admin@172.20.10.5 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '172.20.10.5:2882:2881;172.20.10.7:2882:2881;172.20.10.9:2882:2881' -p 2881 -P 2882 -z 'zone1' -n 'mhsjzt' -c 1714998978 -d '/data' -I '172.20.10.5' -o __min_full_resource_pool_memory=2147483648,memory_limit='105G',memory_limit_percentage=80,system_memory='0M',datafile_size='0M',datafile_disk_percentage=0,log_disk_size='0M',enable_syslog_wf=True,enable_syslog_recycle=True,max_syslog_file_count=5 [2024-07-19 10:56:53.367] [DEBUG] -- exited code 0 [2024-07-19 10:56:53.368] [DEBUG] -- admin@172.20.10.5 delete env LD_LIBRARY_PATH [2024-07-19 10:56:53.368] [DEBUG] -- starting server2(172.20.10.6) observer [2024-07-19 10:56:53.369] [DEBUG] -- admin@172.20.10.6 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2024-07-19 10:56:53.369] [DEBUG] -- admin@172.20.10.6 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '172.20.10.5:2882:2881;172.20.10.7:2882:2881;172.20.10.9:2882:2881' -p 2881 -P 2882 -z 'zone1' -n 'mhsjzt' -c 1714998978 -d '/data' -I '172.20.10.6' -o __min_full_resource_pool_memory=2147483648,memory_limit='105G',memory_limit_percentage=80,system_memory='0M',datafile_size='0M',datafile_disk_percentage=0,log_disk_size='0M',enable_syslog_wf=True,enable_syslog_recycle=True,max_syslog_file_count=5 [2024-07-19 10:56:53.479] [DEBUG] -- exited code 0 [2024-07-19 10:56:53.480] [DEBUG] -- admin@172.20.10.6 delete env LD_LIBRARY_PATH [2024-07-19 10:56:53.480] [DEBUG] -- starting server3(172.20.10.7) observer [2024-07-19 10:56:53.480] [DEBUG] -- admin@172.20.10.7 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2024-07-19 10:56:53.480] [DEBUG] -- admin@172.20.10.7 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '172.20.10.5:2882:2881;172.20.10.7:2882:2881;172.20.10.9:2882:2881' -p 2881 -P 2882 -z 'zone2' -n 'mhsjzt' -c 1714998978 -d '/data' -I '172.20.10.7' -o __min_full_resource_pool_memory=2147483648,memory_limit='105G',memory_limit_percentage=80,system_memory='0M',datafile_size='0M',datafile_disk_percentage=0,log_disk_size='0M',enable_syslog_wf=True,enable_syslog_recycle=True,max_syslog_file_count=5 [2024-07-19 10:56:53.586] [DEBUG] -- exited code 0 [2024-07-19 10:56:53.586] [DEBUG] -- admin@172.20.10.7 delete env LD_LIBRARY_PATH [2024-07-19 10:56:53.586] [DEBUG] -- starting server4(172.20.10.8) observer [2024-07-19 10:56:53.587] [DEBUG] -- admin@172.20.10.8 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2024-07-19 10:56:53.587] [DEBUG] -- admin@172.20.10.8 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '172.20.10.5:2882:2881;172.20.10.7:2882:2881;172.20.10.9:2882:2881' -p 2881 -P 2882 -z 'zone2' -n 'mhsjzt' -c 1714998978 -d '/data' -I '172.20.10.8' -o __min_full_resource_pool_memory=2147483648,memory_limit='105G',memory_limit_percentage=80,system_memory='0M',datafile_size='0M',datafile_disk_percentage=0,log_disk_size='0M',enable_syslog_wf=True,enable_syslog_recycle=True,max_syslog_file_count=5 [2024-07-19 10:56:53.681] [DEBUG] -- exited code 0 [2024-07-19 10:56:53.682] [DEBUG] -- admin@172.20.10.8 delete env LD_LIBRARY_PATH [2024-07-19 10:56:53.682] [DEBUG] -- starting server5(172.20.10.9) observer [2024-07-19 10:56:53.682] [DEBUG] -- admin@172.20.10.9 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2024-07-19 10:56:53.683] [DEBUG] -- admin@172.20.10.9 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '172.20.10.5:2882:2881;172.20.10.7:2882:2881;172.20.10.9:2882:2881' -p 2881 -P 2882 -z 'zone3' -n 'mhsjzt' -c 1714998978 -d '/data' -I '172.20.10.9' -o __min_full_resource_pool_memory=2147483648,memory_limit='105G',memory_limit_percentage=80,system_memory='0M',datafile_size='0M',datafile_disk_percentage=0,log_disk_size='0M',enable_syslog_wf=True,enable_syslog_recycle=True,max_syslog_file_count=5 [2024-07-19 10:56:53.778] [DEBUG] -- exited code 0 [2024-07-19 10:56:53.778] [DEBUG] -- admin@172.20.10.9 delete env LD_LIBRARY_PATH [2024-07-19 10:56:53.778] [DEBUG] -- starting server6(172.20.10.10) observer [2024-07-19 10:56:53.779] [DEBUG] -- admin@172.20.10.10 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2024-07-19 10:56:53.779] [DEBUG] -- admin@172.20.10.10 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '172.20.10.5:2882:2881;172.20.10.7:2882:2881;172.20.10.9:2882:2881' -p 2881 -P 2882 -z 'zone3' -n 'mhsjzt' -c 1714998978 -d '/data' -I '172.20.10.10' -o __min_full_resource_pool_memory=2147483648,memory_limit='105G',memory_limit_percentage=80,system_memory='0M',datafile_size='0M',datafile_disk_percentage=0,log_disk_size='0M',enable_syslog_wf=True,enable_syslog_recycle=True,max_syslog_file_count=5 [2024-07-19 10:56:53.874] [DEBUG] -- exited code 0 [2024-07-19 10:56:53.874] [DEBUG] -- admin@172.20.10.10 delete env LD_LIBRARY_PATH [2024-07-19 10:56:53.906] [DEBUG] -- start_obshell: True [2024-07-19 10:56:53.906] [DEBUG] -- admin@172.20.10.5 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:56:53.959] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:53.959] [DEBUG] cat: /home/admin/observer/run/obshell.pid: No such file or directory [2024-07-19 10:56:53.959] [DEBUG] [2024-07-19 10:56:53.959] [DEBUG] -- admin@172.20.10.5 set env OB_ROOT_PASSWORD to ''FMpbXBeFpAgYh8PNfjCk'' [2024-07-19 10:56:53.959] [DEBUG] -- start obshell: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.5 --port 2886 [2024-07-19 10:56:53.959] [DEBUG] -- admin@172.20.10.5 execute: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.5 --port 2886 [2024-07-19 10:56:56.099] [DEBUG] -- exited code 0 [2024-07-19 10:56:56.099] [DEBUG] -- admin@172.20.10.6 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:56:56.154] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:56.154] [DEBUG] cat: /home/admin/observer/run/obshell.pid: No such file or directory [2024-07-19 10:56:56.154] [DEBUG] [2024-07-19 10:56:56.155] [DEBUG] -- admin@172.20.10.6 set env OB_ROOT_PASSWORD to ''FMpbXBeFpAgYh8PNfjCk'' [2024-07-19 10:56:56.155] [DEBUG] -- start obshell: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.6 --port 2886 [2024-07-19 10:56:56.155] [DEBUG] -- admin@172.20.10.6 execute: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.6 --port 2886 [2024-07-19 10:56:58.313] [DEBUG] -- exited code 0 [2024-07-19 10:56:58.314] [DEBUG] -- admin@172.20.10.7 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:56:58.370] [DEBUG] -- exited code 1, error output: [2024-07-19 10:56:58.370] [DEBUG] cat: /home/admin/observer/run/obshell.pid: No such file or directory [2024-07-19 10:56:58.370] [DEBUG] [2024-07-19 10:56:58.370] [DEBUG] -- admin@172.20.10.7 set env OB_ROOT_PASSWORD to ''FMpbXBeFpAgYh8PNfjCk'' [2024-07-19 10:56:58.371] [DEBUG] -- start obshell: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.7 --port 2886 [2024-07-19 10:56:58.371] [DEBUG] -- admin@172.20.10.7 execute: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.7 --port 2886 [2024-07-19 10:57:00.513] [DEBUG] -- exited code 0 [2024-07-19 10:57:00.513] [DEBUG] -- admin@172.20.10.8 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:57:00.569] [DEBUG] -- exited code 1, error output: [2024-07-19 10:57:00.570] [DEBUG] cat: /home/admin/observer/run/obshell.pid: No such file or directory [2024-07-19 10:57:00.570] [DEBUG] [2024-07-19 10:57:00.570] [DEBUG] -- admin@172.20.10.8 set env OB_ROOT_PASSWORD to ''FMpbXBeFpAgYh8PNfjCk'' [2024-07-19 10:57:00.570] [DEBUG] -- start obshell: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.8 --port 2886 [2024-07-19 10:57:00.570] [DEBUG] -- admin@172.20.10.8 execute: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.8 --port 2886 [2024-07-19 10:57:02.712] [DEBUG] -- exited code 0 [2024-07-19 10:57:02.713] [DEBUG] -- admin@172.20.10.9 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:57:02.769] [DEBUG] -- exited code 1, error output: [2024-07-19 10:57:02.769] [DEBUG] cat: /home/admin/observer/run/obshell.pid: No such file or directory [2024-07-19 10:57:02.769] [DEBUG] [2024-07-19 10:57:02.770] [DEBUG] -- admin@172.20.10.9 set env OB_ROOT_PASSWORD to ''FMpbXBeFpAgYh8PNfjCk'' [2024-07-19 10:57:02.770] [DEBUG] -- start obshell: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.9 --port 2886 [2024-07-19 10:57:02.770] [DEBUG] -- admin@172.20.10.9 execute: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.9 --port 2886 [2024-07-19 10:57:04.915] [DEBUG] -- exited code 0 [2024-07-19 10:57:04.916] [DEBUG] -- admin@172.20.10.10 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:57:04.972] [DEBUG] -- exited code 1, error output: [2024-07-19 10:57:04.973] [DEBUG] cat: /home/admin/observer/run/obshell.pid: No such file or directory [2024-07-19 10:57:04.973] [DEBUG] [2024-07-19 10:57:04.973] [DEBUG] -- admin@172.20.10.10 set env OB_ROOT_PASSWORD to ''FMpbXBeFpAgYh8PNfjCk'' [2024-07-19 10:57:04.973] [DEBUG] -- start obshell: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.10 --port 2886 [2024-07-19 10:57:04.973] [DEBUG] -- admin@172.20.10.10 execute: cd /home/admin/observer; /home/admin/observer/bin/obshell admin start --ip 172.20.10.10 --port 2886 [2024-07-19 10:57:07.133] [DEBUG] -- exited code 0 [2024-07-19 10:57:07.134] [INFO] observer program health check [2024-07-19 10:57:10.138] [DEBUG] -- server1(172.20.10.5) program health check [2024-07-19 10:57:10.138] [DEBUG] -- admin@172.20.10.5 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:57:10.192] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.193] [DEBUG] -- admin@172.20.10.5 execute: ls /proc/1204914 [2024-07-19 10:57:10.293] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.294] [DEBUG] -- server1(172.20.10.5) observer[pid: 1204914] started [2024-07-19 10:57:10.294] [DEBUG] -- server2(172.20.10.6) program health check [2024-07-19 10:57:10.294] [DEBUG] -- admin@172.20.10.6 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:57:10.353] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.353] [DEBUG] -- admin@172.20.10.6 execute: ls /proc/950335 [2024-07-19 10:57:10.451] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.451] [DEBUG] -- server2(172.20.10.6) observer[pid: 950335] started [2024-07-19 10:57:10.451] [DEBUG] -- server3(172.20.10.7) program health check [2024-07-19 10:57:10.451] [DEBUG] -- admin@172.20.10.7 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:57:10.509] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.509] [DEBUG] -- admin@172.20.10.7 execute: ls /proc/3523952 [2024-07-19 10:57:10.606] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.606] [DEBUG] -- server3(172.20.10.7) observer[pid: 3523952] started [2024-07-19 10:57:10.607] [DEBUG] -- server4(172.20.10.8) program health check [2024-07-19 10:57:10.607] [DEBUG] -- admin@172.20.10.8 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:57:10.664] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.664] [DEBUG] -- admin@172.20.10.8 execute: ls /proc/844759 [2024-07-19 10:57:10.769] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.769] [DEBUG] -- server4(172.20.10.8) observer[pid: 844759] started [2024-07-19 10:57:10.769] [DEBUG] -- server5(172.20.10.9) program health check [2024-07-19 10:57:10.769] [DEBUG] -- admin@172.20.10.9 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:57:10.825] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.825] [DEBUG] -- admin@172.20.10.9 execute: ls /proc/3535135 [2024-07-19 10:57:10.933] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.934] [DEBUG] -- server5(172.20.10.9) observer[pid: 3535135] started [2024-07-19 10:57:10.934] [DEBUG] -- server6(172.20.10.10) program health check [2024-07-19 10:57:10.934] [DEBUG] -- admin@172.20.10.10 execute: cat /home/admin/observer/run/observer.pid [2024-07-19 10:57:10.992] [DEBUG] -- exited code 0 [2024-07-19 10:57:10.992] [DEBUG] -- admin@172.20.10.10 execute: ls /proc/986613 [2024-07-19 10:57:11.108] [DEBUG] -- exited code 0 [2024-07-19 10:57:11.108] [DEBUG] -- server6(172.20.10.10) observer[pid: 986613] started [2024-07-19 10:57:11.174] [INFO] obshell program health check [2024-07-19 10:57:11.174] [DEBUG] -- admin@172.20.10.5 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:57:11.232] [DEBUG] -- exited code 0 [2024-07-19 10:57:11.233] [DEBUG] -- admin@172.20.10.5 execute: ls /proc/1205132 [2024-07-19 10:57:11.345] [DEBUG] -- exited code 0 [2024-07-19 10:57:11.346] [DEBUG] -- server1(172.20.10.5) obshell[pid: 1205132] started [2024-07-19 10:57:11.346] [DEBUG] -- admin@172.20.10.6 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:57:11.402] [DEBUG] -- exited code 0 [2024-07-19 10:57:11.402] [DEBUG] -- admin@172.20.10.6 execute: ls /proc/951286 [2024-07-19 10:57:11.509] [DEBUG] -- exited code 0 [2024-07-19 10:57:11.509] [DEBUG] -- server2(172.20.10.6) obshell[pid: 951286] started [2024-07-19 10:57:11.509] [DEBUG] -- admin@172.20.10.7 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:57:11.567] [DEBUG] -- exited code 0 [2024-07-19 10:57:11.567] [DEBUG] -- admin@172.20.10.7 execute: ls /proc/3524974 [2024-07-19 10:57:11.677] [DEBUG] -- exited code 0 [2024-07-19 10:57:11.677] [DEBUG] -- server3(172.20.10.7) obshell[pid: 3524974] started [2024-07-19 10:57:11.678] [DEBUG] -- admin@172.20.10.8 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:57:11.735] [DEBUG] -- exited code 0 [2024-07-19 10:57:11.735] [DEBUG] -- admin@172.20.10.8 execute: ls /proc/845796 [2024-07-19 10:57:11.842] [DEBUG] -- exited code 0 [2024-07-19 10:57:11.842] [DEBUG] -- server4(172.20.10.8) obshell[pid: 845796] started [2024-07-19 10:57:11.843] [DEBUG] -- admin@172.20.10.9 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:57:11.897] [DEBUG] -- exited code 0 [2024-07-19 10:57:11.897] [DEBUG] -- admin@172.20.10.9 execute: ls /proc/3536246 [2024-07-19 10:57:12.013] [DEBUG] -- exited code 0 [2024-07-19 10:57:12.014] [DEBUG] -- server5(172.20.10.9) obshell[pid: 3536246] started [2024-07-19 10:57:12.014] [DEBUG] -- admin@172.20.10.10 execute: cat /home/admin/observer/run/obshell.pid [2024-07-19 10:57:12.072] [DEBUG] -- exited code 0 [2024-07-19 10:57:12.072] [DEBUG] -- admin@172.20.10.10 execute: ls /proc/987752 [2024-07-19 10:57:12.176] [DEBUG] -- exited code 0 [2024-07-19 10:57:12.177] [DEBUG] -- server6(172.20.10.10) obshell[pid: 987752] started [2024-07-19 10:57:12.217] [DEBUG] -- need_bootstrap: False [2024-07-19 10:57:12.217] [DEBUG] - sub start ref count to 0 [2024-07-19 10:57:12.217] [DEBUG] - export start [2024-07-19 10:57:12.217] [DEBUG] - Call oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:57:12.217] [DEBUG] - import connect [2024-07-19 10:57:12.308] [DEBUG] - add connect ref count to 1 [2024-07-19 10:57:12.309] [DEBUG] -- connect obshell (172.20.10.5:2886) [2024-07-19 10:57:12.309] [DEBUG] -- connect obshell (172.20.10.6:2886) [2024-07-19 10:57:12.309] [DEBUG] -- connect obshell (172.20.10.7:2886) [2024-07-19 10:57:12.309] [DEBUG] -- connect obshell (172.20.10.8:2886) [2024-07-19 10:57:12.309] [DEBUG] -- connect obshell (172.20.10.9:2886) [2024-07-19 10:57:12.309] [DEBUG] -- connect obshell (172.20.10.10:2886) [2024-07-19 10:57:12.310] [INFO] Connect to observer [2024-07-19 10:57:12.310] [DEBUG] -- connect 172.20.10.5 -P2881 -uroot -pFMpbXBeFpAgYh8PNfjCk [2024-07-19 10:57:12.312] [DEBUG] -- connect 172.20.10.6 -P2881 -uroot -pFMpbXBeFpAgYh8PNfjCk [2024-07-19 10:57:12.315] [DEBUG] -- connect 172.20.10.7 -P2881 -uroot -pFMpbXBeFpAgYh8PNfjCk [2024-07-19 10:57:12.317] [DEBUG] -- connect 172.20.10.8 -P2881 -uroot -pFMpbXBeFpAgYh8PNfjCk [2024-07-19 10:57:12.319] [DEBUG] -- connect 172.20.10.9 -P2881 -uroot -pFMpbXBeFpAgYh8PNfjCk [2024-07-19 10:57:12.320] [DEBUG] -- connect 172.20.10.10 -P2881 -uroot -pFMpbXBeFpAgYh8PNfjCk [2024-07-19 10:57:15.326] [DEBUG] -- connect 172.20.10.5 -P2881 -uroot -p [2024-07-19 10:57:15.328] [DEBUG] -- execute sql: select 1. args: None [2024-07-19 10:57:15.437] [DEBUG] - sub connect ref count to 0 [2024-07-19 10:57:15.437] [DEBUG] - export connect [2024-07-19 10:57:15.437] [DEBUG] - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.2.0-100010012024022719.el7-c3ab2f9131720e59921045f93c52256a99301478 [2024-07-19 10:57:15.438] [DEBUG] - import display [2024-07-19 10:57:15.439] [DEBUG] - add display ref count to 1 [2024-07-19 10:57:15.439] [INFO] Wait for observer init [2024-07-19 10:57:15.440] [DEBUG] -- execute sql: select * from oceanbase.__all_server. args: None [2024-07-19 10:57:15.440] [DEBUG] -- OBD-5000: select * from oceanbase.__all_server execute failed [2024-07-19 10:57:15.442] [ERROR] Traceback (most recent call last): [2024-07-19 10:57:15.442] [ERROR] File "core.py", line 2020, in start_cluster [2024-07-19 10:57:15.442] [ERROR] File "core.py", line 2144, in _start_cluster [2024-07-19 10:57:15.442] [ERROR] File "core.py", line 188, in call_plugin [2024-07-19 10:57:15.442] [ERROR] File "_plugin.py", line 347, in __call__ [2024-07-19 10:57:15.442] [ERROR] File "_plugin.py", line 305, in _new_func [2024-07-19 10:57:15.443] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/3.1.0/display.py", line 37, in display [2024-07-19 10:57:15.443] [ERROR] servers = cursor.fetchall('select * from oceanbase.__all_server', raise_exception=True, exc_level='verbose') [2024-07-19 10:57:15.443] [ERROR] File "_stdio.py", line 894, in func_wrapper [2024-07-19 10:57:15.443] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py", line 511, in fetchall [2024-07-19 10:57:15.443] [ERROR] return self.execute(sql, args=args, execute_func='fetchall', raise_exception=raise_exception, exc_level=exc_level, stdio=stdio) [2024-07-19 10:57:15.443] [ERROR] File "_stdio.py", line 894, in func_wrapper [2024-07-19 10:57:15.443] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py", line 490, in execute [2024-07-19 10:57:15.443] [ERROR] self.cursor.execute(sql, args) [2024-07-19 10:57:15.443] [ERROR] File "pymysql/cursors.py", line 148, in execute [2024-07-19 10:57:15.443] [ERROR] File "pymysql/cursors.py", line 310, in _query [2024-07-19 10:57:15.443] [ERROR] File "pymysql/connections.py", line 548, in query [2024-07-19 10:57:15.443] [ERROR] File "pymysql/connections.py", line 775, in _read_query_result [2024-07-19 10:57:15.443] [ERROR] File "pymysql/connections.py", line 1156, in read [2024-07-19 10:57:15.443] [ERROR] File "pymysql/connections.py", line 725, in _read_packet [2024-07-19 10:57:15.443] [ERROR] File "pymysql/protocol.py", line 221, in raise_for_error [2024-07-19 10:57:15.443] [ERROR] File "pymysql/err.py", line 143, in raise_mysql_exception [2024-07-19 10:57:15.443] [ERROR] pymysql.err.ProgrammingError: (1146, "Table 'oceanbase.__all_server' doesn't exist") [2024-07-19 10:57:15.443] [ERROR] [2024-07-19 10:57:18.446] [DEBUG] -- execute sql: select * from oceanbase.__all_server. args: None [2024-07-19 10:57:18.448] [DEBUG] -- OBD-5000: select * from oceanbase.__all_server execute failed [2024-07-19 10:57:18.449] [ERROR] Traceback (most recent call last): [2024-07-19 10:57:18.449] [ERROR] File "core.py", line 2020, in start_cluster [2024-07-19 10:57:18.449] [ERROR] File "core.py", line 2144, in _start_cluster [2024-07-19 10:57:18.449] [ERROR] File "core.py", line 188, in call_plugin [2024-07-19 10:57:18.449] [ERROR] File "_plugin.py", line 347, in __call__ [2024-07-19 10:57:18.449] [ERROR] File "_plugin.py", line 305, in _new_func [2024-07-19 10:57:18.449] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/3.1.0/display.py", line 37, in display [2024-07-19 10:57:18.449] [ERROR] servers = cursor.fetchall('select * from oceanbase.__all_server', raise_exception=True, exc_level='verbose') [2024-07-19 10:57:18.449] [ERROR] File "_stdio.py", line 894, in func_wrapper [2024-07-19 10:57:18.449] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py", line 511, in fetchall [2024-07-19 10:57:18.449] [ERROR] return self.execute(sql, args=args, execute_func='fetchall', raise_exception=raise_exception, exc_level=exc_level, stdio=stdio) [2024-07-19 10:57:18.449] [ERROR] File "_stdio.py", line 894, in func_wrapper [2024-07-19 10:57:18.449] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py", line 490, in execute [2024-07-19 10:57:18.449] [ERROR] self.cursor.execute(sql, args) [2024-07-19 10:57:18.450] [ERROR] File "pymysql/cursors.py", line 148, in execute [2024-07-19 10:57:18.450] [ERROR] File "pymysql/cursors.py", line 310, in _query [2024-07-19 10:57:18.450] [ERROR] File "pymysql/connections.py", line 548, in query [2024-07-19 10:57:18.450] [ERROR] File "pymysql/connections.py", line 775, in _read_query_result [2024-07-19 10:57:18.450] [ERROR] File "pymysql/connections.py", line 1156, in read [2024-07-19 10:57:18.450] [ERROR] File "pymysql/connections.py", line 725, in _read_packet [2024-07-19 10:57:18.450] [ERROR] File "pymysql/protocol.py", line 221, in raise_for_error [2024-07-19 10:57:18.450] [ERROR] File "pymysql/err.py", line 143, in raise_mysql_exception [2024-07-19 10:57:18.450] [ERROR] pymysql.err.ProgrammingError: (1146, "Table 'oceanbase.__all_server' doesn't exist") [2024-07-19 10:57:18.450] [ERROR] [2024-07-19 10:57:21.453] [DEBUG] -- execute sql: select * from oceanbase.__all_server. args: None [2024-07-19 10:57:21.453] [DEBUG] -- OBD-5000: select * from oceanbase.__all_server execute failed [2024-07-19 10:57:21.454] [ERROR] Traceback (most recent call last): [2024-07-19 10:57:21.455] [ERROR] File "core.py", line 2020, in start_cluster [2024-07-19 10:57:21.455] [ERROR] File "core.py", line 2144, in _start_cluster [2024-07-19 10:57:21.455] [ERROR] File "core.py", line 188, in call_plugin [2024-07-19 10:57:21.455] [ERROR] File "_plugin.py", line 347, in __call__ [2024-07-19 10:57:21.455] [ERROR] File "_plugin.py", line 305, in _new_func [2024-07-19 10:57:21.455] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/3.1.0/display.py", line 37, in display [2024-07-19 10:57:21.455] [ERROR] servers = cursor.fetchall('select * from oceanbase.__all_server', raise_exception=True, exc_level='verbose') [2024-07-19 10:57:21.455] [ERROR] File "_stdio.py", line 894, in func_wrapper [2024-07-19 10:57:21.455] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py", line 511, in fetchall [2024-07-19 10:57:21.455] [ERROR] return self.execute(sql, args=args, execute_func='fetchall', raise_exception=raise_exception, exc_level=exc_level, stdio=stdio) [2024-07-19 10:57:21.455] [ERROR] File "_stdio.py", line 894, in func_wrapper [2024-07-19 10:57:21.455] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py", line 490, in execute [2024-07-19 10:57:21.455] [ERROR] self.cursor.execute(sql, args) [2024-07-19 10:57:21.455] [ERROR] File "pymysql/cursors.py", line 148, in execute [2024-07-19 10:57:21.455] [ERROR] File "pymysql/cursors.py", line 310, in _query [2024-07-19 10:57:21.455] [ERROR] File "pymysql/connections.py", line 548, in query [2024-07-19 10:57:21.455] [ERROR] File "pymysql/connections.py", line 775, in _read_query_result [2024-07-19 10:57:21.455] [ERROR] File "pymysql/connections.py", line 1156, in read [2024-07-19 10:57:21.455] [ERROR] File "pymysql/connections.py", line 692, in _read_packet [2024-07-19 10:57:21.455] [ERROR] File "pymysql/connections.py", line 748, in _read_bytes [2024-07-19 10:57:21.455] [ERROR] pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query') [2024-07-19 10:57:21.456] [ERROR] [2024-07-19 10:57:21.562] [DEBUG] - sub display ref count to 0 [2024-07-19 10:57:21.562] [DEBUG] - export display [2024-07-19 10:57:21.564] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2024-07-19 10:57:21.564] [INFO] Trace ID: 84ebbfe2-457a-11ef-b626-fa163e0feeb2 [2024-07-19 10:57:21.565] [INFO] If you want to view detailed obd logs, please run: obd display-trace 84ebbfe2-457a-11ef-b626-fa163e0feeb2 [2024-07-19 10:57:21.565] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2024-07-19 10:57:21.565] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2024-07-19 10:57:21.565] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2024-07-19 10:57:21.565] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2024-07-19 10:57:21.565] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2024-07-19 10:57:21.565] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_mhsjzt release, count 0 [2024-07-19 10:57:21.565] [DEBUG] - unlock /home/admin/.obd/lock/deploy_mhsjzt [2024-07-19 10:57:21.565] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2024-07-19 10:57:21.565] [DEBUG] - unlock /home/admin/.obd/lock/global