[admin@vm-ob-utils ~]$ obd display-trace b03e898e-292f-11ef-83b7-080027f315ea [2024-06-13 10:50:26.888] [DEBUG] - cmd: ['ob_prd'] [2024-06-13 10:50:26.889] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2024-06-13 10:50:26.889] [DEBUG] - mkdir /home/admin/.obd/lock/ [2024-06-13 10:50:26.890] [DEBUG] - unknown lock mode [2024-06-13 10:50:26.891] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2024-06-13 10:50:26.891] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2024-06-13 10:50:26.891] [DEBUG] - Get Deploy by name [2024-06-13 10:50:26.891] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2024-06-13 10:50:26.892] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2024-06-13 10:50:26.892] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_ob_prd [2024-06-13 10:50:26.892] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_ob_prd`, count 1 [2024-06-13 10:50:26.903] [DEBUG] - Deploy status judge [2024-06-13 10:50:26.905] [INFO] Get local repositories [2024-06-13 10:50:26.906] [DEBUG] - mkdir /home/admin/.obd/repository [2024-06-13 10:50:26.907] [DEBUG] - Get local repository oceanbase-ce-4.2.1.7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:26.907] [DEBUG] - Search repository oceanbase-ce version: 4.2.1.7, tag: f69097e5f6056a0f6949867a799eea3724a905aa, release: None, package_hash: None [2024-06-13 10:50:26.907] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2024-06-13 10:50:26.907] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2024-06-13 10:50:26.907] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2024-06-13 10:50:26.911] [DEBUG] - Found repository oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:26.911] [DEBUG] - Get local repository obproxy-ce-4.2.3.0-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:26.911] [DEBUG] - Search repository obproxy-ce version: 4.2.3.0, tag: 0490ebc04220def8d25cb9cac9ac61a4efa6d639, release: None, package_hash: None [2024-06-13 10:50:26.911] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2024-06-13 10:50:26.911] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2024-06-13 10:50:26.915] [DEBUG] - Found repository obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:26.915] [DEBUG] - Get local repository obagent-4.2.2-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:26.915] [DEBUG] - Search repository obagent version: 4.2.2, tag: 19739a07a12eab736aff86ecf357b1ae660b554e, release: None, package_hash: None [2024-06-13 10:50:26.915] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2024-06-13 10:50:26.915] [DEBUG] - mkdir /home/admin/.obd/repository/obagent [2024-06-13 10:50:26.919] [DEBUG] - Found repository obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:26.919] [DEBUG] - Get local repository ocp-express-4.2.2-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:26.919] [DEBUG] - Search repository ocp-express version: 4.2.2, tag: 09ffcf156d1df9318a78af52656f499d2315e3f7, release: None, package_hash: None [2024-06-13 10:50:26.919] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2024-06-13 10:50:26.919] [DEBUG] - mkdir /home/admin/.obd/repository/ocp-express [2024-06-13 10:50:26.922] [DEBUG] - Found repository ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:26.922] [DEBUG] - Get local repository ob-configserver-1.0.0-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:26.923] [DEBUG] - Search repository ob-configserver version: 1.0.0, tag: feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0, release: None, package_hash: None [2024-06-13 10:50:26.923] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2024-06-13 10:50:26.923] [DEBUG] - mkdir /home/admin/.obd/repository/ob-configserver [2024-06-13 10:50:26.927] [DEBUG] - Found repository ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:27.040] [DEBUG] - Get deploy config [2024-06-13 10:50:27.091] [INFO] Search plugins [2024-06-13 10:50:27.093] [DEBUG] - Searching start_check plugin for components ... [2024-06-13 10:50:27.093] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:27.093] [DEBUG] - mkdir /home/admin/.obd/plugins [2024-06-13 10:50:27.100] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.2.1.4 for oceanbase-ce-4.2.1.7 [2024-06-13 10:50:27.100] [DEBUG] - Searching start_check plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:27.101] [DEBUG] - Found for obproxy-ce-py_script_start_check-4.2.3 for obproxy-ce-4.2.3.0 [2024-06-13 10:50:27.102] [DEBUG] - Searching start_check plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:27.104] [DEBUG] - Found for obagent-py_script_start_check-1.3.0 for obagent-4.2.2 [2024-06-13 10:50:27.104] [DEBUG] - Searching start_check plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:27.106] [DEBUG] - Found for ocp-express-py_script_start_check-4.2.2 for ocp-express-4.2.2 [2024-06-13 10:50:27.106] [DEBUG] - Searching start_check plugin for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:27.107] [DEBUG] - Found for ob-configserver-py_script_start_check-1.0.0 for ob-configserver-1.0.0 [2024-06-13 10:50:27.107] [DEBUG] - Searching create_tenant plugin for components ... [2024-06-13 10:50:27.107] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:27.108] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.2.0.0 for oceanbase-ce-4.2.1.7 [2024-06-13 10:50:27.108] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:27.109] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.2.3.0 [2024-06-13 10:50:27.109] [DEBUG] - Searching create_tenant plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:27.109] [DEBUG] - No such create_tenant plugin for obagent-4.2.2 [2024-06-13 10:50:27.109] [DEBUG] - Searching create_tenant plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:27.109] [DEBUG] - No such create_tenant plugin for ocp-express-4.2.2 [2024-06-13 10:50:27.109] [DEBUG] - Searching create_tenant plugin for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:27.110] [DEBUG] - No such create_tenant plugin for ob-configserver-1.0.0 [2024-06-13 10:50:27.110] [DEBUG] - Searching tenant_optimize plugin for components ... [2024-06-13 10:50:27.110] [DEBUG] - Searching tenant_optimize plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:27.111] [DEBUG] - No such tenant_optimize plugin for oceanbase-ce-4.2.1.7 [2024-06-13 10:50:27.111] [DEBUG] - Searching tenant_optimize plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:27.111] [DEBUG] - No such tenant_optimize plugin for obproxy-ce-4.2.3.0 [2024-06-13 10:50:27.111] [DEBUG] - Searching tenant_optimize plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:27.112] [DEBUG] - No such tenant_optimize plugin for obagent-4.2.2 [2024-06-13 10:50:27.112] [DEBUG] - Searching tenant_optimize plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:27.112] [DEBUG] - No such tenant_optimize plugin for ocp-express-4.2.2 [2024-06-13 10:50:27.112] [DEBUG] - Searching tenant_optimize plugin for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:27.112] [DEBUG] - No such tenant_optimize plugin for ob-configserver-1.0.0 [2024-06-13 10:50:27.112] [DEBUG] - Searching start plugin for components ... [2024-06-13 10:50:27.113] [DEBUG] - Searching start plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:27.114] [DEBUG] - Found for oceanbase-ce-py_script_start-4.2.1.4 for oceanbase-ce-4.2.1.7 [2024-06-13 10:50:27.114] [DEBUG] - Searching start plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:27.115] [DEBUG] - Found for obproxy-ce-py_script_start-4.2.3 for obproxy-ce-4.2.3.0 [2024-06-13 10:50:27.115] [DEBUG] - Searching start plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:27.116] [DEBUG] - Found for obagent-py_script_start-1.3.0 for obagent-4.2.2 [2024-06-13 10:50:27.116] [DEBUG] - Searching start plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:27.116] [DEBUG] - Found for ocp-express-py_script_start-4.2.2 for ocp-express-4.2.2 [2024-06-13 10:50:27.116] [DEBUG] - Searching start plugin for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:27.116] [DEBUG] - Found for ob-configserver-py_script_start-1.0.0 for ob-configserver-1.0.0 [2024-06-13 10:50:27.116] [DEBUG] - Searching connect plugin for components ... [2024-06-13 10:50:27.117] [DEBUG] - Searching connect plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:27.118] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.1.4 for oceanbase-ce-4.2.1.7 [2024-06-13 10:50:27.118] [DEBUG] - Searching connect plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:27.118] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.3.0 [2024-06-13 10:50:27.118] [DEBUG] - Searching connect plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:27.119] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-4.2.2 [2024-06-13 10:50:27.119] [DEBUG] - Searching connect plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:27.119] [DEBUG] - Found for ocp-express-py_script_connect-1.0.1 for ocp-express-4.2.2 [2024-06-13 10:50:27.119] [DEBUG] - Searching connect plugin for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:27.120] [DEBUG] - Found for ob-configserver-py_script_connect-1.0.0 for ob-configserver-1.0.0 [2024-06-13 10:50:27.120] [DEBUG] - Searching bootstrap plugin for components ... [2024-06-13 10:50:27.120] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:27.121] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.2.1.4 for oceanbase-ce-4.2.1.7 [2024-06-13 10:50:27.121] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:27.121] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.2.3.0 [2024-06-13 10:50:27.121] [DEBUG] - Searching bootstrap plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:27.121] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-4.2.2 [2024-06-13 10:50:27.121] [DEBUG] - Searching bootstrap plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:27.122] [DEBUG] - Found for ocp-express-py_script_bootstrap-1.0.1 for ocp-express-4.2.2 [2024-06-13 10:50:27.122] [DEBUG] - Searching bootstrap plugin for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:27.122] [DEBUG] - Found for ob-configserver-py_script_bootstrap-1.0.0 for ob-configserver-1.0.0 [2024-06-13 10:50:27.122] [DEBUG] - Searching display plugin for components ... [2024-06-13 10:50:27.122] [DEBUG] - Searching display plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:27.123] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.1.7 [2024-06-13 10:50:27.123] [DEBUG] - Searching display plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:27.123] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.3.0 [2024-06-13 10:50:27.123] [DEBUG] - Searching display plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:27.123] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-4.2.2 [2024-06-13 10:50:27.123] [DEBUG] - Searching display plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:27.123] [DEBUG] - Found for ocp-express-py_script_display-1.0.1 for ocp-express-4.2.2 [2024-06-13 10:50:27.124] [DEBUG] - Searching display plugin for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:27.124] [DEBUG] - Found for ob-configserver-py_script_display-1.0.0 for ob-configserver-1.0.0 [2024-06-13 10:50:27.319] [INFO] Load cluster param plugin [2024-06-13 10:50:27.321] [DEBUG] - Get local repository oceanbase-ce-4.2.1.7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:27.321] [DEBUG] - Get local repository obproxy-ce-4.2.3.0-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:27.321] [DEBUG] - Get local repository obagent-4.2.2-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:27.321] [DEBUG] - Get local repository ocp-express-4.2.2-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:27.321] [DEBUG] - Get local repository ob-configserver-1.0.0-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:27.322] [DEBUG] - Searching param plugin for components ... [2024-06-13 10:50:27.322] [DEBUG] - Search param plugin for oceanbase-ce [2024-06-13 10:50:27.323] [DEBUG] - Found for oceanbase-ce-param-4.2.1.4 for oceanbase-ce-4.2.1.7 [2024-06-13 10:50:27.323] [DEBUG] - Applying oceanbase-ce-param-4.2.1.4 for oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:28.094] [DEBUG] - Search param plugin for obproxy-ce [2024-06-13 10:50:28.094] [DEBUG] - Found for obproxy-ce-param-4.2.3 for obproxy-ce-4.2.3.0 [2024-06-13 10:50:28.094] [DEBUG] - Applying obproxy-ce-param-4.2.3 for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:28.288] [DEBUG] - Search param plugin for obagent [2024-06-13 10:50:28.288] [DEBUG] - Found for obagent-param-1.3.0 for obagent-4.2.2 [2024-06-13 10:50:28.289] [DEBUG] - Applying obagent-param-1.3.0 for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:28.378] [DEBUG] - Search param plugin for ocp-express [2024-06-13 10:50:28.379] [DEBUG] - Found for ocp-express-param-4.1.0 for ocp-express-4.2.2 [2024-06-13 10:50:28.379] [DEBUG] - Applying ocp-express-param-4.1.0 for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:28.513] [DEBUG] - Search param plugin for ob-configserver [2024-06-13 10:50:28.514] [DEBUG] - Found for ob-configserver-param-1.0.0 for ob-configserver-1.0.0 [2024-06-13 10:50:28.514] [DEBUG] - Applying ob-configserver-param-1.0.0 for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:28.615] [INFO] Open ssh connection [2024-06-13 10:50:28.622] [DEBUG] - host: 192.168.58.181, port: 22, user: admin, password: admin [2024-06-13 10:50:28.754] [DEBUG] - host: 192.168.58.182, port: 22, user: admin, password: admin [2024-06-13 10:50:28.891] [DEBUG] - host: 192.168.58.183, port: 22, user: admin, password: admin [2024-06-13 10:50:29.148] [DEBUG] - Call ob-configserver-py_script_start_check-1.0.0 for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:29.148] [DEBUG] - import start_check [2024-06-13 10:50:29.155] [DEBUG] - add start_check ref count to 1 [2024-06-13 10:50:29.156] [INFO] Check before start ob-configserver [2024-06-13 10:50:29.158] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/obconfigserver/run/ob-configserver.pid [2024-06-13 10:50:29.190] [DEBUG] -- exited code 0 [2024-06-13 10:50:29.191] [DEBUG] -- admin@192.168.58.181 execute: ls /proc/2285 [2024-06-13 10:50:29.267] [DEBUG] -- exited code 2, error output: [2024-06-13 10:50:29.267] [DEBUG] ls: 无法访问/proc/2285: 没有那个文件或目录 [2024-06-13 10:50:29.267] [DEBUG] [2024-06-13 10:50:29.267] [DEBUG] -- 192.168.58.181 port check [2024-06-13 10:50:29.267] [DEBUG] -- admin@192.168.58.181 execute: bash -c 'cat /proc/net/tcp*' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':1F90' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:29.401] [DEBUG] -- exited code 0 [2024-06-13 10:50:29.401] [DEBUG] -- 192.168.58.181 parameter check [2024-06-13 10:50:29.402] [DEBUG] -- 192.168.58.181 database check [2024-06-13 10:50:29.425] [DEBUG] - sub start_check ref count to 0 [2024-06-13 10:50:29.425] [DEBUG] - export start_check [2024-06-13 10:50:29.426] [DEBUG] - plugin ob-configserver-py_script_start_check-1.0.0 result: True [2024-06-13 10:50:29.426] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.2.1.4 for oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:29.426] [DEBUG] - import start_check [2024-06-13 10:50:29.444] [DEBUG] - add start_check ref count to 1 [2024-06-13 10:50:29.445] [INFO] Check before start observer [2024-06-13 10:50:29.447] [DEBUG] -- admin@192.168.58.181 execute: ls /ob_data/clog/tenant_1/ [2024-06-13 10:50:29.505] [DEBUG] -- exited code 0 [2024-06-13 10:50:29.506] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/oceanbase/run/observer.pid [2024-06-13 10:50:29.578] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:29.578] [DEBUG] cat: /ob_soft/ob_prd/oceanbase/run/observer.pid: 没有那个文件或目录 [2024-06-13 10:50:29.578] [DEBUG] [2024-06-13 10:50:29.578] [DEBUG] -- 192.168.58.181 port check [2024-06-13 10:50:29.578] [DEBUG] -- admin@192.168.58.181 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B41' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:29.663] [DEBUG] -- exited code 0 [2024-06-13 10:50:29.663] [DEBUG] -- admin@192.168.58.181 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B42' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:29.753] [DEBUG] -- exited code 0 [2024-06-13 10:50:29.753] [DEBUG] -- admin@192.168.58.181 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B46' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:29.833] [DEBUG] -- exited code 0 [2024-06-13 10:50:29.834] [DEBUG] -- admin@192.168.58.181 execute: ls /ob_data/sstable/block_file [2024-06-13 10:50:30.005] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.007] [DEBUG] -- admin@192.168.58.182 execute: cat /ob_soft/ob_prd/oceanbase/run/observer.pid [2024-06-13 10:50:30.036] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:30.037] [DEBUG] cat: /ob_soft/ob_prd/oceanbase/run/observer.pid: 没有那个文件或目录 [2024-06-13 10:50:30.037] [DEBUG] [2024-06-13 10:50:30.037] [DEBUG] -- 192.168.58.182 port check [2024-06-13 10:50:30.037] [DEBUG] -- admin@192.168.58.182 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B41' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:30.110] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.111] [DEBUG] -- admin@192.168.58.182 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B42' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:30.192] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.192] [DEBUG] -- admin@192.168.58.182 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B46' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:30.357] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.358] [DEBUG] -- admin@192.168.58.182 execute: ls /ob_data/sstable/block_file [2024-06-13 10:50:30.430] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.432] [DEBUG] -- admin@192.168.58.183 execute: cat /ob_soft/ob_prd/oceanbase/run/observer.pid [2024-06-13 10:50:30.458] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:30.459] [DEBUG] cat: /ob_soft/ob_prd/oceanbase/run/observer.pid: 没有那个文件或目录 [2024-06-13 10:50:30.459] [DEBUG] [2024-06-13 10:50:30.459] [DEBUG] -- 192.168.58.183 port check [2024-06-13 10:50:30.459] [DEBUG] -- admin@192.168.58.183 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B41' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:30.536] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.537] [DEBUG] -- admin@192.168.58.183 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B42' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:30.608] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.608] [DEBUG] -- admin@192.168.58.183 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B46' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:30.686] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.686] [DEBUG] -- admin@192.168.58.183 execute: ls /ob_data/sstable/block_file [2024-06-13 10:50:30.890] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.891] [DEBUG] -- admin@192.168.58.183 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ] [2024-06-13 10:50:30.957] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.958] [DEBUG] -- admin@192.168.58.181 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-06-13 10:50:30.983] [DEBUG] -- exited code 0 [2024-06-13 10:50:30.984] [DEBUG] -- admin@192.168.58.181 execute: ulimit -a [2024-06-13 10:50:31.054] [DEBUG] -- exited code 0 [2024-06-13 10:50:31.056] [DEBUG] -- admin@192.168.58.181 execute: sysctl -a [2024-06-13 10:50:31.191] [DEBUG] -- exited code 0 [2024-06-13 10:50:31.193] [DEBUG] -- admin@192.168.58.181 execute: cat /proc/meminfo [2024-06-13 10:50:31.272] [DEBUG] -- exited code 0 [2024-06-13 10:50:31.273] [DEBUG] -- admin@192.168.58.181 execute: df --block-size=1024 [2024-06-13 10:50:31.416] [DEBUG] -- exited code 0 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /dev, total: 12628213760 avail: 12628213760 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /dev/shm, total: 12640243712 avail: 12640243712 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /run, total: 12640243712 avail: 12631101440 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 12640243712 avail: 12640243712 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /, total: 53672411136 avail: 51264507904 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /tmp, total: 10726932480 avail: 10693033984 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /ob_data, total: 31572529152 avail: 19161247744 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /ob_log, total: 105550635008 avail: 35140943872 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /ob_soft, total: 105554829312 avail: 98689302528 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /home, total: 21464350720 avail: 20110950400 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /boot, total: 1063256064 avail: 875847680 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /run/user/0, total: 2528051200 avail: 2528051200 [2024-06-13 10:50:31.417] [DEBUG] -- get disk info for path /run/user/1500, total: 2528051200 avail: 2528051200 [2024-06-13 10:50:31.417] [DEBUG] -- disk: {'/dev': {'total': 12628213760, 'avail': 12628213760, 'need': 0}, '/dev/shm': {'total': 12640243712, 'avail': 12640243712, 'need': 0}, '/run': {'total': 12640243712, 'avail': 12631101440, 'need': 0}, '/sys/fs/cgroup': {'total': 12640243712, 'avail': 12640243712, 'need': 0}, '/': {'total': 53672411136, 'avail': 51264507904, 'need': 0}, '/tmp': {'total': 10726932480, 'avail': 10693033984, 'need': 0}, '/ob_data': {'total': 31572529152, 'avail': 19161247744, 'need': 0}, '/ob_log': {'total': 105550635008, 'avail': 35140943872, 'need': 0}, '/ob_soft': {'total': 105554829312, 'avail': 98689302528, 'need': 0}, '/home': {'total': 21464350720, 'avail': 20110950400, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 875847680, 'need': 0}, '/run/user/0': {'total': 2528051200, 'avail': 2528051200, 'need': 0}, '/run/user/1500': {'total': 2528051200, 'avail': 2528051200, 'need': 0}} [2024-06-13 10:50:31.418] [DEBUG] -- admin@192.168.58.181 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ] [2024-06-13 10:50:31.483] [DEBUG] -- exited code 0 [2024-06-13 10:50:31.483] [DEBUG] -- admin@192.168.58.182 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-06-13 10:50:31.511] [DEBUG] -- exited code 0 [2024-06-13 10:50:31.511] [DEBUG] -- admin@192.168.58.182 execute: ulimit -a [2024-06-13 10:50:31.739] [DEBUG] -- exited code 0 [2024-06-13 10:50:31.739] [DEBUG] -- admin@192.168.58.182 execute: sysctl -a [2024-06-13 10:50:31.882] [DEBUG] -- exited code 0 [2024-06-13 10:50:31.889] [DEBUG] -- admin@192.168.58.182 execute: cat /proc/meminfo [2024-06-13 10:50:31.958] [DEBUG] -- exited code 0 [2024-06-13 10:50:31.959] [DEBUG] -- admin@192.168.58.182 execute: df --block-size=1024 [2024-06-13 10:50:32.095] [DEBUG] -- exited code 0 [2024-06-13 10:50:32.096] [DEBUG] -- get disk info for path /dev, total: 12628213760 avail: 12628213760 [2024-06-13 10:50:32.096] [DEBUG] -- get disk info for path /dev/shm, total: 12640243712 avail: 12640243712 [2024-06-13 10:50:32.096] [DEBUG] -- get disk info for path /run, total: 12640243712 avail: 12631101440 [2024-06-13 10:50:32.097] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 12640243712 avail: 12640243712 [2024-06-13 10:50:32.097] [DEBUG] -- get disk info for path /, total: 53672411136 avail: 51264643072 [2024-06-13 10:50:32.097] [DEBUG] -- get disk info for path /tmp, total: 10726932480 avail: 10693066752 [2024-06-13 10:50:32.097] [DEBUG] -- get disk info for path /ob_data, total: 31572529152 avail: 19161255936 [2024-06-13 10:50:32.097] [DEBUG] -- get disk info for path /ob_soft, total: 105554829312 avail: 99080806400 [2024-06-13 10:50:32.097] [DEBUG] -- get disk info for path /ob_log, total: 105550635008 avail: 35140943872 [2024-06-13 10:50:32.097] [DEBUG] -- get disk info for path /home, total: 21464350720 avail: 20213800960 [2024-06-13 10:50:32.097] [DEBUG] -- get disk info for path /boot, total: 1063256064 avail: 875847680 [2024-06-13 10:50:32.097] [DEBUG] -- get disk info for path /run/user/0, total: 2528051200 avail: 2528051200 [2024-06-13 10:50:32.097] [DEBUG] -- get disk info for path /run/user/1500, total: 2528051200 avail: 2528051200 [2024-06-13 10:50:32.097] [DEBUG] -- disk: {'/dev': {'total': 12628213760, 'avail': 12628213760, 'need': 0}, '/dev/shm': {'total': 12640243712, 'avail': 12640243712, 'need': 0}, '/run': {'total': 12640243712, 'avail': 12631101440, 'need': 0}, '/sys/fs/cgroup': {'total': 12640243712, 'avail': 12640243712, 'need': 0}, '/': {'total': 53672411136, 'avail': 51264643072, 'need': 0}, '/tmp': {'total': 10726932480, 'avail': 10693066752, 'need': 0}, '/ob_data': {'total': 31572529152, 'avail': 19161255936, 'need': 0}, '/ob_soft': {'total': 105554829312, 'avail': 99080806400, 'need': 0}, '/ob_log': {'total': 105550635008, 'avail': 35140943872, 'need': 0}, '/home': {'total': 21464350720, 'avail': 20213800960, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 875847680, 'need': 0}, '/run/user/0': {'total': 2528051200, 'avail': 2528051200, 'need': 0}, '/run/user/1500': {'total': 2528051200, 'avail': 2528051200, 'need': 0}} [2024-06-13 10:50:32.098] [DEBUG] -- admin@192.168.58.182 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ] [2024-06-13 10:50:32.159] [DEBUG] -- exited code 0 [2024-06-13 10:50:32.160] [DEBUG] -- admin@192.168.58.183 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-06-13 10:50:32.187] [DEBUG] -- exited code 0 [2024-06-13 10:50:32.188] [DEBUG] -- admin@192.168.58.183 execute: ulimit -a [2024-06-13 10:50:32.380] [DEBUG] -- exited code 0 [2024-06-13 10:50:32.381] [DEBUG] -- admin@192.168.58.183 execute: sysctl -a [2024-06-13 10:50:32.720] [DEBUG] -- exited code 0 [2024-06-13 10:50:32.723] [DEBUG] -- admin@192.168.58.183 execute: cat /proc/meminfo [2024-06-13 10:50:32.839] [DEBUG] -- exited code 0 [2024-06-13 10:50:32.840] [DEBUG] -- admin@192.168.58.183 execute: df --block-size=1024 [2024-06-13 10:50:32.941] [DEBUG] -- exited code 0 [2024-06-13 10:50:32.942] [DEBUG] -- get disk info for path /dev, total: 12628209664 avail: 12628209664 [2024-06-13 10:50:32.942] [DEBUG] -- get disk info for path /dev/shm, total: 12640239616 avail: 12640239616 [2024-06-13 10:50:32.942] [DEBUG] -- get disk info for path /run, total: 12640239616 avail: 12631097344 [2024-06-13 10:50:32.942] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 12640239616 avail: 12640239616 [2024-06-13 10:50:32.942] [DEBUG] -- get disk info for path /, total: 53672411136 avail: 51265802240 [2024-06-13 10:50:32.942] [DEBUG] -- get disk info for path /tmp, total: 10726932480 avail: 10693066752 [2024-06-13 10:50:32.943] [DEBUG] -- get disk info for path /ob_data, total: 31572529152 avail: 19161251840 [2024-06-13 10:50:32.943] [DEBUG] -- get disk info for path /ob_log, total: 105550635008 avail: 35190566912 [2024-06-13 10:50:32.943] [DEBUG] -- get disk info for path /ob_soft, total: 105554829312 avail: 99086991360 [2024-06-13 10:50:32.943] [DEBUG] -- get disk info for path /home, total: 21464350720 avail: 20213800960 [2024-06-13 10:50:32.943] [DEBUG] -- get disk info for path /boot, total: 1063256064 avail: 875847680 [2024-06-13 10:50:32.943] [DEBUG] -- get disk info for path /run/user/0, total: 2528051200 avail: 2528051200 [2024-06-13 10:50:32.943] [DEBUG] -- get disk info for path /run/user/1500, total: 2528051200 avail: 2528051200 [2024-06-13 10:50:32.943] [DEBUG] -- disk: {'/dev': {'total': 12628209664, 'avail': 12628209664, 'need': 0}, '/dev/shm': {'total': 12640239616, 'avail': 12640239616, 'need': 0}, '/run': {'total': 12640239616, 'avail': 12631097344, 'need': 0}, '/sys/fs/cgroup': {'total': 12640239616, 'avail': 12640239616, 'need': 0}, '/': {'total': 53672411136, 'avail': 51265802240, 'need': 0}, '/tmp': {'total': 10726932480, 'avail': 10693066752, 'need': 0}, '/ob_data': {'total': 31572529152, 'avail': 19161251840, 'need': 0}, '/ob_log': {'total': 105550635008, 'avail': 35190566912, 'need': 0}, '/ob_soft': {'total': 105554829312, 'avail': 99086991360, 'need': 0}, '/home': {'total': 21464350720, 'avail': 20213800960, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 875847680, 'need': 0}, '/run/user/0': {'total': 2528051200, 'avail': 2528051200, 'need': 0}, '/run/user/1500': {'total': 2528051200, 'avail': 2528051200, 'need': 0}} [2024-06-13 10:50:32.944] [DEBUG] -- admin@192.168.58.181 execute: date +%s%N [2024-06-13 10:50:32.972] [DEBUG] -- exited code 0 [2024-06-13 10:50:32.973] [DEBUG] -- 192.168.58.181 time delta -3.0029296875 [2024-06-13 10:50:32.973] [DEBUG] -- admin@192.168.58.182 execute: date +%s%N [2024-06-13 10:50:33.001] [DEBUG] -- exited code 0 [2024-06-13 10:50:33.002] [DEBUG] -- 192.168.58.182 time delta -2.647705078125 [2024-06-13 10:50:33.002] [DEBUG] -- admin@192.168.58.183 execute: date +%s%N [2024-06-13 10:50:33.023] [DEBUG] -- exited code 0 [2024-06-13 10:50:33.023] [DEBUG] -- 192.168.58.183 time delta -1.27197265625 [2024-06-13 10:50:33.068] [DEBUG] - sub start_check ref count to 0 [2024-06-13 10:50:33.068] [DEBUG] - export start_check [2024-06-13 10:50:33.068] [DEBUG] - plugin oceanbase-ce-py_script_start_check-4.2.1.4 result: True [2024-06-13 10:50:33.068] [DEBUG] - Call obproxy-ce-py_script_start_check-4.2.3 for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639 [2024-06-13 10:50:33.069] [DEBUG] - import start_check [2024-06-13 10:50:33.074] [DEBUG] - add start_check ref count to 1 [2024-06-13 10:50:33.075] [INFO] Check before start obproxy [2024-06-13 10:50:33.076] [WARNING] OBD-4521: The config observer_sys_password in obproxy-ce did not take effect, please config it in oceanbase-ce [2024-06-13 10:50:33.077] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/obproxy/run/obproxy-192.168.58.181-2883.pid [2024-06-13 10:50:33.107] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:33.107] [DEBUG] cat: /ob_soft/ob_prd/obproxy/run/obproxy-192.168.58.181-2883.pid: 没有那个文件或目录 [2024-06-13 10:50:33.108] [DEBUG] [2024-06-13 10:50:33.108] [DEBUG] -- 192.168.58.181 port check [2024-06-13 10:50:33.108] [DEBUG] -- admin@192.168.58.181 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B43' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:33.191] [DEBUG] -- exited code 0 [2024-06-13 10:50:33.192] [DEBUG] -- admin@192.168.58.181 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B44' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:33.271] [DEBUG] -- exited code 0 [2024-06-13 10:50:33.272] [DEBUG] -- admin@192.168.58.182 execute: cat /ob_soft/ob_prd/obproxy/run/obproxy-192.168.58.182-2883.pid [2024-06-13 10:50:33.299] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:33.300] [DEBUG] cat: /ob_soft/ob_prd/obproxy/run/obproxy-192.168.58.182-2883.pid: 没有那个文件或目录 [2024-06-13 10:50:33.300] [DEBUG] [2024-06-13 10:50:33.300] [DEBUG] -- 192.168.58.182 port check [2024-06-13 10:50:33.300] [DEBUG] -- admin@192.168.58.182 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B43' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:33.469] [DEBUG] -- exited code 0 [2024-06-13 10:50:33.469] [DEBUG] -- admin@192.168.58.182 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B44' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:33.549] [DEBUG] -- exited code 0 [2024-06-13 10:50:33.550] [DEBUG] -- admin@192.168.58.183 execute: cat /ob_soft/ob_prd/obproxy/run/obproxy-192.168.58.183-2883.pid [2024-06-13 10:50:33.582] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:33.582] [DEBUG] cat: /ob_soft/ob_prd/obproxy/run/obproxy-192.168.58.183-2883.pid: 没有那个文件或目录 [2024-06-13 10:50:33.582] [DEBUG] [2024-06-13 10:50:33.583] [DEBUG] -- 192.168.58.183 port check [2024-06-13 10:50:33.583] [DEBUG] -- admin@192.168.58.183 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B43' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:33.658] [DEBUG] -- exited code 0 [2024-06-13 10:50:33.659] [DEBUG] -- admin@192.168.58.183 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B44' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:33.736] [DEBUG] -- exited code 0 [2024-06-13 10:50:33.746] [INFO] [WARN] OBD-4521: The config observer_sys_password in obproxy-ce did not take effect, please config it in oceanbase-ce [2024-06-13 10:50:33.746] [INFO] [2024-06-13 10:50:33.746] [DEBUG] - sub start_check ref count to 0 [2024-06-13 10:50:33.746] [DEBUG] - export start_check [2024-06-13 10:50:33.746] [DEBUG] - plugin obproxy-ce-py_script_start_check-4.2.3 result: True [2024-06-13 10:50:33.746] [DEBUG] - Call obagent-py_script_start_check-1.3.0 for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e [2024-06-13 10:50:33.747] [DEBUG] - import start_check [2024-06-13 10:50:33.751] [DEBUG] - add start_check ref count to 1 [2024-06-13 10:50:33.752] [INFO] Check before start obagent [2024-06-13 10:50:33.758] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/obagent/run/ob_agentd.pid [2024-06-13 10:50:33.786] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:33.786] [DEBUG] cat: /ob_soft/ob_prd/obagent/run/ob_agentd.pid: 没有那个文件或目录 [2024-06-13 10:50:33.786] [DEBUG] [2024-06-13 10:50:33.787] [DEBUG] -- 192.168.58.181 port check [2024-06-13 10:50:33.787] [DEBUG] -- admin@192.168.58.181 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':1F99' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:33.876] [DEBUG] -- exited code 0 [2024-06-13 10:50:33.877] [DEBUG] -- admin@192.168.58.181 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':1F98' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:33.956] [DEBUG] -- exited code 0 [2024-06-13 10:50:33.957] [DEBUG] -- admin@192.168.58.182 execute: cat /ob_soft/ob_prd/obagent/run/ob_agentd.pid [2024-06-13 10:50:33.984] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:33.985] [DEBUG] cat: /ob_soft/ob_prd/obagent/run/ob_agentd.pid: 没有那个文件或目录 [2024-06-13 10:50:33.985] [DEBUG] [2024-06-13 10:50:33.985] [DEBUG] -- 192.168.58.182 port check [2024-06-13 10:50:33.985] [DEBUG] -- admin@192.168.58.182 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':1F99' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:34.065] [DEBUG] -- exited code 0 [2024-06-13 10:50:34.066] [DEBUG] -- admin@192.168.58.182 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':1F98' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:34.243] [DEBUG] -- exited code 0 [2024-06-13 10:50:34.243] [DEBUG] -- admin@192.168.58.183 execute: cat /ob_soft/ob_prd/obagent/run/ob_agentd.pid [2024-06-13 10:50:34.274] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:34.275] [DEBUG] cat: /ob_soft/ob_prd/obagent/run/ob_agentd.pid: 没有那个文件或目录 [2024-06-13 10:50:34.275] [DEBUG] [2024-06-13 10:50:34.275] [DEBUG] -- 192.168.58.183 port check [2024-06-13 10:50:34.275] [DEBUG] -- admin@192.168.58.183 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':1F99' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:34.371] [DEBUG] -- exited code 0 [2024-06-13 10:50:34.372] [DEBUG] -- admin@192.168.58.183 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':1F98' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:34.572] [DEBUG] -- exited code 0 [2024-06-13 10:50:34.717] [DEBUG] - sub start_check ref count to 0 [2024-06-13 10:50:34.718] [DEBUG] - export start_check [2024-06-13 10:50:34.718] [DEBUG] - plugin obagent-py_script_start_check-1.3.0 result: True [2024-06-13 10:50:34.718] [DEBUG] - Call ocp-express-py_script_start_check-4.2.2 for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7 [2024-06-13 10:50:34.718] [DEBUG] - import start_check [2024-06-13 10:50:34.732] [DEBUG] - add start_check ref count to 1 [2024-06-13 10:50:34.733] [INFO] Check before start ocp-express [2024-06-13 10:50:34.740] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/ocpexpress/run/ocp-express.pid [2024-06-13 10:50:34.769] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:34.769] [DEBUG] cat: /ob_soft/ob_prd/ocpexpress/run/ocp-express.pid: 没有那个文件或目录 [2024-06-13 10:50:34.769] [DEBUG] [2024-06-13 10:50:34.770] [DEBUG] -- admin@192.168.58.181 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':1FF4' | awk -F' ' '{print $3}' | uniq [2024-06-13 10:50:34.855] [DEBUG] -- exited code 0 [2024-06-13 10:50:34.856] [DEBUG] -- admin@192.168.58.181 append '/ob_soft/ob_prd/ocpexpress/jre/bin:' to PATH [2024-06-13 10:50:34.856] [DEBUG] -- admin@192.168.58.181 execute: java -version [2024-06-13 10:50:35.154] [DEBUG] -- exited code 0 [2024-06-13 10:50:35.155] [DEBUG] -- admin@192.168.58.181 execute: cat /proc/meminfo [2024-06-13 10:50:35.250] [DEBUG] -- exited code 0 [2024-06-13 10:50:35.251] [DEBUG] -- admin@192.168.58.181 execute: df --block-size=1024 [2024-06-13 10:50:35.322] [DEBUG] -- exited code 0 [2024-06-13 10:50:35.323] [DEBUG] -- get disk info for path /dev, total: 12628213760 avail: 12628213760 [2024-06-13 10:50:35.323] [DEBUG] -- get disk info for path /dev/shm, total: 12640243712 avail: 12640243712 [2024-06-13 10:50:35.323] [DEBUG] -- get disk info for path /run, total: 12640243712 avail: 12631101440 [2024-06-13 10:50:35.323] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 12640243712 avail: 12640243712 [2024-06-13 10:50:35.323] [DEBUG] -- get disk info for path /, total: 53672411136 avail: 51264507904 [2024-06-13 10:50:35.323] [DEBUG] -- get disk info for path /tmp, total: 10726932480 avail: 10693066752 [2024-06-13 10:50:35.323] [DEBUG] -- get disk info for path /ob_data, total: 31572529152 avail: 19161247744 [2024-06-13 10:50:35.323] [DEBUG] -- get disk info for path /ob_log, total: 105550635008 avail: 35140943872 [2024-06-13 10:50:35.323] [DEBUG] -- get disk info for path /ob_soft, total: 105554829312 avail: 98689302528 [2024-06-13 10:50:35.324] [DEBUG] -- get disk info for path /home, total: 21464350720 avail: 20110950400 [2024-06-13 10:50:35.324] [DEBUG] -- get disk info for path /boot, total: 1063256064 avail: 875847680 [2024-06-13 10:50:35.324] [DEBUG] -- get disk info for path /run/user/0, total: 2528051200 avail: 2528051200 [2024-06-13 10:50:35.324] [DEBUG] -- get disk info for path /run/user/1500, total: 2528051200 avail: 2528051200 [2024-06-13 10:50:35.324] [DEBUG] -- admin@192.168.58.181 execute: df --block-size=1024 /ob_soft/ob_prd/ocpexpress/log [2024-06-13 10:50:35.391] [DEBUG] -- exited code 0 [2024-06-13 10:50:35.392] [DEBUG] -- get disk info for path /ob_soft, total: 105554829312 avail: 98689302528 [2024-06-13 10:50:35.419] [DEBUG] - sub start_check ref count to 0 [2024-06-13 10:50:35.420] [DEBUG] - export start_check [2024-06-13 10:50:35.420] [DEBUG] - plugin ocp-express-py_script_start_check-4.2.2 result: True [2024-06-13 10:50:35.420] [DEBUG] - Call ob-configserver-py_script_start-1.0.0 for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:35.420] [DEBUG] - import start [2024-06-13 10:50:35.424] [DEBUG] - add start ref count to 1 [2024-06-13 10:50:35.425] [INFO] Start ob-configserver [2024-06-13 10:50:35.426] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/obconfigserver/run/ob-configserver.pid [2024-06-13 10:50:35.462] [DEBUG] -- exited code 0 [2024-06-13 10:50:35.463] [DEBUG] -- admin@192.168.58.181 execute: ls /proc/2285 [2024-06-13 10:50:35.533] [DEBUG] -- exited code 2, error output: [2024-06-13 10:50:35.534] [DEBUG] ls: 无法访问/proc/2285: 没有那个文件或目录 [2024-06-13 10:50:35.534] [DEBUG] [2024-06-13 10:50:35.540] [DEBUG] -- write log: [2024-06-13 10:50:35.540] [DEBUG] level: info [2024-06-13 10:50:35.540] [DEBUG] filename: /ob_soft/ob_prd/obconfigserver/log/ob-configserver.log [2024-06-13 10:50:35.540] [DEBUG] maxsize: 30 [2024-06-13 10:50:35.540] [DEBUG] maxage: 7 [2024-06-13 10:50:35.540] [DEBUG] maxbackups: 10 [2024-06-13 10:50:35.540] [DEBUG] localtime: true [2024-06-13 10:50:35.540] [DEBUG] compress: true [2024-06-13 10:50:35.541] [DEBUG] server: [2024-06-13 10:50:35.541] [DEBUG] address: 0.0.0.0:8080 [2024-06-13 10:50:35.541] [DEBUG] run_dir: run [2024-06-13 10:50:35.541] [DEBUG] vip: [2024-06-13 10:50:35.541] [DEBUG] address: 192.168.58.181 [2024-06-13 10:50:35.541] [DEBUG] port: 8080 [2024-06-13 10:50:35.541] [DEBUG] storage: [2024-06-13 10:50:35.541] [DEBUG] database_type: sqlite3 [2024-06-13 10:50:35.541] [DEBUG] connection_url: /ob_soft/ob_prd/obconfigserver/.data.db?cache=shared&_fk=1 [2024-06-13 10:50:35.541] [DEBUG] to admin@192.168.58.181:22: /ob_soft/ob_prd/obconfigserver/conf/ob-configserver.yaml [2024-06-13 10:50:35.635] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2024-06-13 10:50:35.636] [DEBUG] -- admin@192.168.58.181 execute: mkdir -p /ob_soft/ob_prd/obconfigserver/conf && rm -fr /ob_soft/ob_prd/obconfigserver/conf/ob-configserver.yaml [2024-06-13 10:50:35.664] [DEBUG] -- exited code 0 [2024-06-13 10:50:35.665] [DEBUG] -- send /tmp/tmp67hku68u to /ob_soft/ob_prd/obconfigserver/conf/ob-configserver.yaml [2024-06-13 10:50:35.715] [DEBUG] - admin@192.168.58.181 execute: chmod 600 /ob_soft/ob_prd/obconfigserver/conf/ob-configserver.yaml [2024-06-13 10:50:35.742] [DEBUG] - exited code 0 [2024-06-13 10:50:35.743] [DEBUG] -- admin@192.168.58.181 execute: nohup /ob_soft/ob_prd/obconfigserver/bin/ob-configserver -c /ob_soft/ob_prd/obconfigserver/conf/ob-configserver.yaml >> /ob_soft/ob_prd/obconfigserver/log/ob-configserver.log 2>&1 & echo $! > /ob_soft/ob_prd/obconfigserver/run/ob-configserver.pid [2024-06-13 10:50:35.815] [DEBUG] -- exited code 0 [2024-06-13 10:50:35.826] [INFO] ob-configserver program health check [2024-06-13 10:50:36.833] [DEBUG] -- 192.168.58.181 program health check [2024-06-13 10:50:36.834] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/obconfigserver/run/ob-configserver.pid [2024-06-13 10:50:36.857] [DEBUG] -- exited code 0 [2024-06-13 10:50:36.858] [DEBUG] -- admin@192.168.58.181 execute: ls /proc/2336 [2024-06-13 10:50:36.930] [DEBUG] -- exited code 0 [2024-06-13 10:50:36.930] [DEBUG] -- 192.168.58.181 ob-configserver[pid: 2336] started [2024-06-13 10:50:36.939] [DEBUG] - sub start ref count to 0 [2024-06-13 10:50:36.939] [DEBUG] - export start [2024-06-13 10:50:36.939] [DEBUG] - plugin ob-configserver-py_script_start-1.0.0 result: True [2024-06-13 10:50:36.940] [DEBUG] - Call ob-configserver-py_script_connect-1.0.0 for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:36.940] [DEBUG] - import connect [2024-06-13 10:50:36.947] [DEBUG] - add connect ref count to 1 [2024-06-13 10:50:36.947] [INFO] Connect to ob-configserver [2024-06-13 10:50:37.114] [DEBUG] - sub connect ref count to 0 [2024-06-13 10:50:37.114] [DEBUG] - export connect [2024-06-13 10:50:37.114] [DEBUG] - plugin ob-configserver-py_script_connect-1.0.0 result: True [2024-06-13 10:50:37.115] [DEBUG] - Call oceanbase-ce-py_script_start-4.2.1.4 for oceanbase-ce-4.2.1.7-107000162024060611.el7-f69097e5f6056a0f6949867a799eea3724a905aa [2024-06-13 10:50:37.115] [DEBUG] - import start [2024-06-13 10:50:37.120] [DEBUG] - add start ref count to 1 [2024-06-13 10:50:37.121] [INFO] Start observer [2024-06-13 10:50:37.122] [DEBUG] -- admin@192.168.58.181 execute: ls /ob_data/clog/tenant_1/ [2024-06-13 10:50:37.151] [DEBUG] -- exited code 0 [2024-06-13 10:50:37.152] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/oceanbase/run/observer.pid [2024-06-13 10:50:37.224] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:37.224] [DEBUG] cat: /ob_soft/ob_prd/oceanbase/run/observer.pid: 没有那个文件或目录 [2024-06-13 10:50:37.224] [DEBUG] [2024-06-13 10:50:37.224] [DEBUG] -- 192.168.58.181 start command construction [2024-06-13 10:50:37.225] [DEBUG] -- admin@192.168.58.182 execute: ls /ob_data/clog/tenant_1/ [2024-06-13 10:50:37.256] [DEBUG] -- exited code 0 [2024-06-13 10:50:37.256] [DEBUG] -- admin@192.168.58.182 execute: cat /ob_soft/ob_prd/oceanbase/run/observer.pid [2024-06-13 10:50:37.326] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:37.326] [DEBUG] cat: /ob_soft/ob_prd/oceanbase/run/observer.pid: 没有那个文件或目录 [2024-06-13 10:50:37.326] [DEBUG] [2024-06-13 10:50:37.327] [DEBUG] -- 192.168.58.182 start command construction [2024-06-13 10:50:37.327] [DEBUG] -- admin@192.168.58.183 execute: ls /ob_data/clog/tenant_1/ [2024-06-13 10:50:37.394] [DEBUG] -- exited code 0 [2024-06-13 10:50:37.394] [DEBUG] -- admin@192.168.58.183 execute: cat /ob_soft/ob_prd/oceanbase/run/observer.pid [2024-06-13 10:50:37.528] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:37.529] [DEBUG] cat: /ob_soft/ob_prd/oceanbase/run/observer.pid: 没有那个文件或目录 [2024-06-13 10:50:37.529] [DEBUG] [2024-06-13 10:50:37.529] [DEBUG] -- 192.168.58.183 start command construction [2024-06-13 10:50:37.529] [DEBUG] -- starting 192.168.58.181 observer [2024-06-13 10:50:37.530] [DEBUG] -- admin@192.168.58.181 set env LD_LIBRARY_PATH to '/ob_soft/ob_prd/oceanbase/lib:' [2024-06-13 10:50:37.530] [DEBUG] -- admin@192.168.58.181 execute: cd /ob_soft/ob_prd/oceanbase; /ob_soft/ob_prd/oceanbase/bin/observer -p 2881 -P 2882 -z 'zone1' -n 'ob_prd' -c 1718183106 -d '/ob_data' -I '192.168.58.181' -o __min_full_resource_pool_memory=2147483648,datafile_size='10G',datafile_maxsize='25G',datafile_next='5G',enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit='20653M',system_memory='5120M',log_disk_size='61958M',cpu_count=16,obconfig_url='http://192.168.58.181:8080/services?Action=ObRootServiceInfo&ObCluster=ob_prd' [2024-06-13 10:50:37.849] [DEBUG] -- exited code 0 [2024-06-13 10:50:37.850] [DEBUG] -- admin@192.168.58.181 delete env LD_LIBRARY_PATH [2024-06-13 10:50:37.850] [DEBUG] -- starting 192.168.58.182 observer [2024-06-13 10:50:37.850] [DEBUG] -- admin@192.168.58.182 set env LD_LIBRARY_PATH to '/ob_soft/ob_prd/oceanbase/lib:' [2024-06-13 10:50:37.851] [DEBUG] -- admin@192.168.58.182 execute: cd /ob_soft/ob_prd/oceanbase; /ob_soft/ob_prd/oceanbase/bin/observer -p 2881 -P 2882 -z 'zone2' -n 'ob_prd' -c 1718183106 -d '/ob_data' -I '192.168.58.182' -o __min_full_resource_pool_memory=2147483648,datafile_size='10G',datafile_maxsize='25G',datafile_next='5G',enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit='20653M',system_memory='5120M',log_disk_size='61958M',cpu_count=16,obconfig_url='http://192.168.58.181:8080/services?Action=ObRootServiceInfo&ObCluster=ob_prd' [2024-06-13 10:50:38.192] [DEBUG] -- exited code 0 [2024-06-13 10:50:38.192] [DEBUG] -- admin@192.168.58.182 delete env LD_LIBRARY_PATH [2024-06-13 10:50:38.192] [DEBUG] -- starting 192.168.58.183 observer [2024-06-13 10:50:38.193] [DEBUG] -- admin@192.168.58.183 set env LD_LIBRARY_PATH to '/ob_soft/ob_prd/oceanbase/lib:' [2024-06-13 10:50:38.194] [DEBUG] -- admin@192.168.58.183 execute: cd /ob_soft/ob_prd/oceanbase; /ob_soft/ob_prd/oceanbase/bin/observer -p 2881 -P 2882 -z 'zone3' -n 'ob_prd' -c 1718183106 -d '/ob_data' -I '192.168.58.183' -o __min_full_resource_pool_memory=2147483648,datafile_size='10G',datafile_maxsize='25G',datafile_next='5G',enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit='20653M',system_memory='5120M',log_disk_size='61958M',cpu_count=16,obconfig_url='http://192.168.58.181:8080/services?Action=ObRootServiceInfo&ObCluster=ob_prd' [2024-06-13 10:50:38.571] [DEBUG] -- exited code 0 [2024-06-13 10:50:38.571] [DEBUG] -- admin@192.168.58.183 delete env LD_LIBRARY_PATH [2024-06-13 10:50:38.634] [DEBUG] -- start_obshell: True [2024-06-13 10:50:38.635] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/oceanbase/run/obshell.pid [2024-06-13 10:50:38.715] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:38.715] [DEBUG] cat: /ob_soft/ob_prd/oceanbase/run/obshell.pid: 没有那个文件或目录 [2024-06-13 10:50:38.715] [DEBUG] [2024-06-13 10:50:38.716] [DEBUG] -- admin@192.168.58.181 set env OB_ROOT_PASSWORD to ''Ora11cle'' [2024-06-13 10:50:38.716] [DEBUG] -- start obshell: cd /ob_soft/ob_prd/oceanbase; /ob_soft/ob_prd/oceanbase/bin/obshell admin start --ip 192.168.58.181 --port 2886 [2024-06-13 10:50:38.716] [DEBUG] -- admin@192.168.58.181 execute: cd /ob_soft/ob_prd/oceanbase; /ob_soft/ob_prd/oceanbase/bin/obshell admin start --ip 192.168.58.181 --port 2886 [2024-06-13 10:50:39.021] [DEBUG] -- exited code 0 [2024-06-13 10:50:39.021] [DEBUG] -- admin@192.168.58.182 execute: cat /ob_soft/ob_prd/oceanbase/run/obshell.pid [2024-06-13 10:50:39.064] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:39.065] [DEBUG] cat: /ob_soft/ob_prd/oceanbase/run/obshell.pid: 没有那个文件或目录 [2024-06-13 10:50:39.065] [DEBUG] [2024-06-13 10:50:39.065] [DEBUG] -- admin@192.168.58.182 set env OB_ROOT_PASSWORD to ''Ora11cle'' [2024-06-13 10:50:39.065] [DEBUG] -- start obshell: cd /ob_soft/ob_prd/oceanbase; /ob_soft/ob_prd/oceanbase/bin/obshell admin start --ip 192.168.58.182 --port 2886 [2024-06-13 10:50:39.065] [DEBUG] -- admin@192.168.58.182 execute: cd /ob_soft/ob_prd/oceanbase; /ob_soft/ob_prd/oceanbase/bin/obshell admin start --ip 192.168.58.182 --port 2886 [2024-06-13 10:50:41.453] [DEBUG] -- exited code 0 [2024-06-13 10:50:41.453] [DEBUG] -- admin@192.168.58.183 execute: cat /ob_soft/ob_prd/oceanbase/run/obshell.pid [2024-06-13 10:50:41.524] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:41.524] [DEBUG] cat: /ob_soft/ob_prd/oceanbase/run/obshell.pid: 没有那个文件或目录 [2024-06-13 10:50:41.524] [DEBUG] [2024-06-13 10:50:41.525] [DEBUG] -- admin@192.168.58.183 set env OB_ROOT_PASSWORD to ''Ora11cle'' [2024-06-13 10:50:41.525] [DEBUG] -- start obshell: cd /ob_soft/ob_prd/oceanbase; /ob_soft/ob_prd/oceanbase/bin/obshell admin start --ip 192.168.58.183 --port 2886 [2024-06-13 10:50:41.525] [DEBUG] -- admin@192.168.58.183 execute: cd /ob_soft/ob_prd/oceanbase; /ob_soft/ob_prd/oceanbase/bin/obshell admin start --ip 192.168.58.183 --port 2886 [2024-06-13 10:50:43.888] [DEBUG] -- exited code 0 [2024-06-13 10:50:43.889] [INFO] observer program health check [2024-06-13 10:50:46.893] [DEBUG] -- 192.168.58.181 program health check [2024-06-13 10:50:46.894] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/oceanbase/run/observer.pid [2024-06-13 10:50:46.945] [DEBUG] -- exited code 0 [2024-06-13 10:50:46.946] [DEBUG] -- admin@192.168.58.181 execute: ls /proc/2415 [2024-06-13 10:50:47.066] [DEBUG] -- exited code 0 [2024-06-13 10:50:47.067] [DEBUG] -- 192.168.58.181 observer[pid: 2415] started [2024-06-13 10:50:47.067] [DEBUG] -- 192.168.58.182 program health check [2024-06-13 10:50:47.067] [DEBUG] -- admin@192.168.58.182 execute: cat /ob_soft/ob_prd/oceanbase/run/observer.pid [2024-06-13 10:50:47.137] [DEBUG] -- exited code 0 [2024-06-13 10:50:47.137] [DEBUG] -- admin@192.168.58.182 execute: ls /proc/2124 [2024-06-13 10:50:47.272] [DEBUG] -- exited code 0 [2024-06-13 10:50:47.272] [DEBUG] -- 192.168.58.182 observer[pid: 2124] started [2024-06-13 10:50:47.272] [DEBUG] -- 192.168.58.183 program health check [2024-06-13 10:50:47.273] [DEBUG] -- admin@192.168.58.183 execute: cat /ob_soft/ob_prd/oceanbase/run/observer.pid [2024-06-13 10:50:47.359] [DEBUG] -- exited code 0 [2024-06-13 10:50:47.360] [DEBUG] -- admin@192.168.58.183 execute: ls /proc/2120 [2024-06-13 10:50:47.499] [DEBUG] -- exited code 0 [2024-06-13 10:50:47.499] [DEBUG] -- 192.168.58.183 observer[pid: 2120] started [2024-06-13 10:50:47.561] [INFO] obshell program health check [2024-06-13 10:50:47.562] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/oceanbase/run/obshell.pid [2024-06-13 10:50:47.650] [DEBUG] -- exited code 1, error output: [2024-06-13 10:50:47.650] [DEBUG] cat: /ob_soft/ob_prd/oceanbase/run/obshell.pid: 没有那个文件或目录 [2024-06-13 10:50:47.650] [DEBUG] [2024-06-13 10:50:47.651] [DEBUG] -- admin@192.168.58.182 execute: cat /ob_soft/ob_prd/oceanbase/run/obshell.pid [2024-06-13 10:50:47.727] [DEBUG] -- exited code 0 [2024-06-13 10:50:47.727] [DEBUG] -- admin@192.168.58.182 execute: ls /proc/2516 [2024-06-13 10:50:47.838] [DEBUG] -- exited code 0 [2024-06-13 10:50:47.838] [DEBUG] -- 192.168.58.182 obshell[pid: 2516] started [2024-06-13 10:50:47.839] [DEBUG] -- admin@192.168.58.183 execute: cat /ob_soft/ob_prd/oceanbase/run/obshell.pid [2024-06-13 10:50:47.907] [DEBUG] -- exited code 0 [2024-06-13 10:50:47.908] [DEBUG] -- admin@192.168.58.183 execute: ls /proc/2750 [2024-06-13 10:50:48.022] [DEBUG] -- exited code 0 [2024-06-13 10:50:48.022] [DEBUG] -- 192.168.58.183 obshell[pid: 2750] started [2024-06-13 10:50:48.088] [WARNING] OBD-2012: Failed to start 192.168.58.181 obshell [2024-06-13 10:50:48.088] [DEBUG] - sub start ref count to 0 [2024-06-13 10:50:48.088] [DEBUG] - export start [2024-06-13 10:50:48.088] [DEBUG] - plugin oceanbase-ce-py_script_start-4.2.1.4 result: False [2024-06-13 10:50:48.088] [ERROR] oceanbase-ce start failed [2024-06-13 10:50:48.089] [DEBUG] - Call ob-configserver-py_script_display-1.0.0 for ob-configserver-1.0.0-2.el7-feca6b9c76e26ac49464f34bfa0780b5a8d3f4a0 [2024-06-13 10:50:48.089] [DEBUG] - import display [2024-06-13 10:50:48.090] [DEBUG] - add display ref count to 1 [2024-06-13 10:50:48.091] [DEBUG] -- admin@192.168.58.181 execute: cat /ob_soft/ob_prd/obconfigserver/run/ob-configserver.pid [2024-06-13 10:50:48.169] [DEBUG] -- exited code 0 [2024-06-13 10:50:48.171] [INFO] +-------------------------------------------------------------------+ [2024-06-13 10:50:48.171] [INFO] | ob-configserver | [2024-06-13 10:50:48.171] [INFO] +----------------+------+----------------+----------+--------+------+ [2024-06-13 10:50:48.171] [INFO] | server | port | vip_address | vip_port | status | pid | [2024-06-13 10:50:48.172] [INFO] +----------------+------+----------------+----------+--------+------+ [2024-06-13 10:50:48.172] [INFO] | 192.168.58.181 | 8080 | 192.168.58.181 | 8080 | active | 2336 | [2024-06-13 10:50:48.172] [INFO] +----------------+------+----------------+----------+--------+------+ [2024-06-13 10:50:48.172] [INFO] curl -s 'http://192.168.58.181:8080/services?Action=GetObProxyConfig' [2024-06-13 10:50:48.172] [DEBUG] - sub display ref count to 0 [2024-06-13 10:50:48.172] [DEBUG] - export display [2024-06-13 10:50:48.172] [DEBUG] - plugin ob-configserver-py_script_display-1.0.0 result: True [2024-06-13 10:50:48.176] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2024-06-13 10:50:48.176] [INFO] Trace ID: b03e898e-292f-11ef-83b7-080027f315ea [2024-06-13 10:50:48.176] [INFO] If you want to view detailed obd logs, please run: obd display-trace b03e898e-292f-11ef-83b7-080027f315ea [2024-06-13 10:50:48.177] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2024-06-13 10:50:48.177] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2024-06-13 10:50:48.177] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2024-06-13 10:50:48.177] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2024-06-13 10:50:48.178] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2024-06-13 10:50:48.178] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2024-06-13 10:50:48.178] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_ob_prd release, count 0 [2024-06-13 10:50:48.178] [DEBUG] - unlock /home/admin/.obd/lock/deploy_ob_prd [2024-06-13 10:50:48.178] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2024-06-13 10:50:48.178] [DEBUG] - unlock /home/admin/.obd/lock/global