[root@ha1 ~]# obd cluster start my Get local repositories ok Search plugins ok Load cluster param plugin ok Open ssh connection ok Check before start observer ok Check before start obproxy ok Check before start ocp-server ok cluster scenario: htap Start observer ok observer program health check ok obshell program health check ok Connect to observer 192.168.20.71:2881 ok Start obproxy ok obproxy program health check ok Connect to obproxy ok Initialize obproxy-ce ok [ERROR] ocp-server-ce-py_script_start-4.2.1 RuntimeError: (1045, "Access denied for user 'root@ocp_meta'@'192.168.20.71' (using password: YES)") [ERROR] ocp-server-ce start failed Wait for observer init ok +--------------------------------------------------+ | observer | +----------------+---------+------+-------+--------+ | ip | version | port | zone | status | +----------------+---------+------+-------+--------+ | 192.168.20.103 | 4.3.2.1 | 2881 | zone2 | ACTIVE | | 192.168.20.71 | 4.3.2.1 | 2881 | zone1 | ACTIVE | +----------------+---------+------+-------+--------+ obclient -h192.168.20.103 -P2881 -uroot -p'xf2024**AA' -Doceanbase -A cluster unique id: 54358466-369c-59c4-8888-f028c3537a8e-19172c138c0-01020304 +--------------------------------------------------+ | obproxy | +----------------+------+-----------------+--------+ | ip | port | prometheus_port | status | +----------------+------+-----------------+--------+ | 192.168.20.71 | 2883 | 2884 | active | | 192.168.20.103 | 2883 | 2884 | active | +----------------+------+-----------------+--------+ obclient -h192.168.20.71 -P2883 -uroot@proxysys -p'xf2024**AA' -Doceanbase -A See https://www.oceanbase.com/product/ob-deployer/error-codes . Trace ID: ef93f4c2-5f65-11ef-9963-5254000d58c3 If you want to view detailed obd logs, please run: obd display-trace ef93f4c2-5f65-11ef-9963-5254000d58c3 [root@ha1 ~]# obd display-trace ef93f4c2-5f65-11ef-9963-5254000d58c3 [2024-08-21 10:34:48.757] [DEBUG] - cmd: ['my'] [2024-08-21 10:34:48.757] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2024-08-21 10:34:48.757] [DEBUG] - mkdir /root/.obd/lock/ [2024-08-21 10:34:48.758] [DEBUG] - unknown lock mode [2024-08-21 10:34:48.758] [DEBUG] - try to get share lock /root/.obd/lock/global [2024-08-21 10:34:48.758] [DEBUG] - share lock `/root/.obd/lock/global`, count 1 [2024-08-21 10:34:48.758] [DEBUG] - Get Deploy by name [2024-08-21 10:34:48.758] [DEBUG] - mkdir /root/.obd/cluster/ [2024-08-21 10:34:48.759] [DEBUG] - mkdir /root/.obd/config_parser/ [2024-08-21 10:34:48.759] [DEBUG] - try to get exclusive lock /root/.obd/lock/deploy_my [2024-08-21 10:34:48.759] [DEBUG] - exclusive lock `/root/.obd/lock/deploy_my`, count 1 [2024-08-21 10:34:48.766] [DEBUG] - Deploy status judge [2024-08-21 10:34:48.767] [INFO] Get local repositories [2024-08-21 10:34:48.767] [DEBUG] - mkdir /root/.obd/repository [2024-08-21 10:34:48.768] [DEBUG] - Get local repository oceanbase-ce-4.3.2.1-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:48.768] [DEBUG] - Search repository oceanbase-ce version: 4.3.2.1, tag: 8f61ee3cb7c07eed1b2bd5be45085f2451411e96, release: None, package_hash: None [2024-08-21 10:34:48.768] [DEBUG] - try to get share lock /root/.obd/lock/mirror_and_repo [2024-08-21 10:34:48.768] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 1 [2024-08-21 10:34:48.768] [DEBUG] - mkdir /root/.obd/repository/oceanbase-ce [2024-08-21 10:34:48.771] [DEBUG] - Found repository oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:48.771] [DEBUG] - Get local repository obproxy-ce-4.3.1.0-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:48.771] [DEBUG] - Search repository obproxy-ce version: 4.3.1.0, tag: 835f4803c1f4da186439323b66c51db4662678a3, release: None, package_hash: None [2024-08-21 10:34:48.771] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 2 [2024-08-21 10:34:48.771] [DEBUG] - mkdir /root/.obd/repository/obproxy-ce [2024-08-21 10:34:48.774] [DEBUG] - Found repository obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:48.774] [DEBUG] - Get local repository ocp-server-ce-4.3.1-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:48.774] [DEBUG] - Search repository ocp-server-ce version: 4.3.1, tag: bd4512f9f708fb510d98f245b1be0b03a05e2cba, release: None, package_hash: None [2024-08-21 10:34:48.774] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 3 [2024-08-21 10:34:48.774] [DEBUG] - mkdir /root/.obd/repository/ocp-server-ce [2024-08-21 10:34:48.777] [DEBUG] - Found repository ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:48.898] [DEBUG] - Get deploy config [2024-08-21 10:34:48.936] [INFO] Search plugins [2024-08-21 10:34:48.936] [DEBUG] - Searching start_check plugin for components ... [2024-08-21 10:34:48.937] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:48.937] [DEBUG] - mkdir /root/.obd/plugins [2024-08-21 10:34:48.938] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.3.0.0 for oceanbase-ce-4.3.2.1 [2024-08-21 10:34:48.939] [DEBUG] - Searching start_check plugin for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:48.939] [DEBUG] - Found for obproxy-ce-py_script_start_check-4.2.3 for obproxy-ce-4.3.1.0 [2024-08-21 10:34:48.939] [DEBUG] - Searching start_check plugin for ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:48.939] [DEBUG] - Found for ocp-server-ce-py_script_start_check-4.2.2 for ocp-server-ce-4.3.1 [2024-08-21 10:34:48.939] [DEBUG] - Searching create_tenant plugin for components ... [2024-08-21 10:34:48.939] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:48.940] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.3.0.0 for oceanbase-ce-4.3.2.1 [2024-08-21 10:34:48.940] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:48.940] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.3.1.0 [2024-08-21 10:34:48.941] [DEBUG] - Searching create_tenant plugin for ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:48.941] [DEBUG] - No such create_tenant plugin for ocp-server-ce-4.3.1 [2024-08-21 10:34:48.941] [DEBUG] - Searching tenant_optimize plugin for components ... [2024-08-21 10:34:48.941] [DEBUG] - Searching tenant_optimize plugin for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:48.941] [DEBUG] - Found for oceanbase-ce-py_script_tenant_optimize-4.3.0.0 for oceanbase-ce-4.3.2.1 [2024-08-21 10:34:48.941] [DEBUG] - Searching tenant_optimize plugin for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:48.942] [DEBUG] - No such tenant_optimize plugin for obproxy-ce-4.3.1.0 [2024-08-21 10:34:48.942] [DEBUG] - Searching tenant_optimize plugin for ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:48.942] [DEBUG] - No such tenant_optimize plugin for ocp-server-ce-4.3.1 [2024-08-21 10:34:48.942] [DEBUG] - Searching start plugin for components ... [2024-08-21 10:34:48.942] [DEBUG] - Searching start plugin for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:48.943] [DEBUG] - Found for oceanbase-ce-py_script_start-4.3.0.0 for oceanbase-ce-4.3.2.1 [2024-08-21 10:34:48.943] [DEBUG] - Searching start plugin for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:48.944] [DEBUG] - Found for obproxy-ce-py_script_start-4.2.3 for obproxy-ce-4.3.1.0 [2024-08-21 10:34:48.944] [DEBUG] - Searching start plugin for ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:48.944] [DEBUG] - Found for ocp-server-ce-py_script_start-4.2.1 for ocp-server-ce-4.3.1 [2024-08-21 10:34:48.944] [DEBUG] - Searching connect plugin for components ... [2024-08-21 10:34:48.944] [DEBUG] - Searching connect plugin for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:48.945] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.2.1 [2024-08-21 10:34:48.945] [DEBUG] - Searching connect plugin for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:48.945] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.3.1.0 [2024-08-21 10:34:48.945] [DEBUG] - Searching connect plugin for ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:48.945] [DEBUG] - Found for ocp-server-ce-py_script_connect-4.2.1 for ocp-server-ce-4.3.1 [2024-08-21 10:34:48.945] [DEBUG] - Searching bootstrap plugin for components ... [2024-08-21 10:34:48.946] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:48.946] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.2.2.0 for oceanbase-ce-4.3.2.1 [2024-08-21 10:34:48.946] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:48.947] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.3.1.0 [2024-08-21 10:34:48.947] [DEBUG] - Searching bootstrap plugin for ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:48.947] [DEBUG] - Found for ocp-server-ce-py_script_bootstrap-4.2.1 for ocp-server-ce-4.3.1 [2024-08-21 10:34:48.947] [DEBUG] - Searching display plugin for components ... [2024-08-21 10:34:48.947] [DEBUG] - Searching display plugin for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:48.948] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.3.2.1 [2024-08-21 10:34:48.948] [DEBUG] - Searching display plugin for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:48.948] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.3.1.0 [2024-08-21 10:34:48.948] [DEBUG] - Searching display plugin for ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:48.948] [DEBUG] - Found for ocp-server-ce-py_script_display-4.2.1 for ocp-server-ce-4.3.1 [2024-08-21 10:34:49.068] [INFO] Load cluster param plugin [2024-08-21 10:34:49.068] [DEBUG] - Get local repository oceanbase-ce-4.3.2.1-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:49.069] [DEBUG] - Get local repository obproxy-ce-4.3.1.0-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:49.069] [DEBUG] - Get local repository ocp-server-ce-4.3.1-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:49.069] [DEBUG] - Searching param plugin for components ... [2024-08-21 10:34:49.069] [DEBUG] - Search param plugin for oceanbase-ce [2024-08-21 10:34:49.070] [DEBUG] - Found for oceanbase-ce-param-4.3.0.0 for oceanbase-ce-4.3.2.1 [2024-08-21 10:34:49.070] [DEBUG] - Applying oceanbase-ce-param-4.3.0.0 for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:49.728] [DEBUG] - Search param plugin for obproxy-ce [2024-08-21 10:34:49.729] [DEBUG] - Found for obproxy-ce-param-4.2.3 for obproxy-ce-4.3.1.0 [2024-08-21 10:34:49.729] [DEBUG] - Applying obproxy-ce-param-4.2.3 for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:49.878] [DEBUG] - Search param plugin for ocp-server-ce [2024-08-21 10:34:49.879] [DEBUG] - Found for ocp-server-ce-param-4.2.1 for ocp-server-ce-4.3.1 [2024-08-21 10:34:49.879] [DEBUG] - Applying ocp-server-ce-param-4.2.1 for ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:50.114] [INFO] Open ssh connection [2024-08-21 10:34:50.119] [DEBUG] - host: 192.168.20.71, port: 22, user: root, password: xf2024*A [2024-08-21 10:34:50.202] [DEBUG] - host: 192.168.20.103, port: 22, user: root, password: xf2024*A [2024-08-21 10:34:50.375] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.3.0.0 for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:50.375] [DEBUG] - import start_check [2024-08-21 10:34:50.385] [DEBUG] - add start_check ref count to 1 [2024-08-21 10:34:50.386] [INFO] Check before start observer [2024-08-21 10:34:50.388] [DEBUG] -- root@192.168.20.71 execute: ls /data/1/clog/tenant_1/ [2024-08-21 10:34:50.447] [DEBUG] -- exited code 0 [2024-08-21 10:34:50.448] [DEBUG] -- root@192.168.20.71 execute: cat /home/root/oceanbase/run/observer.pid [2024-08-21 10:34:50.542] [DEBUG] -- exited code 0 [2024-08-21 10:34:50.543] [DEBUG] -- root@192.168.20.71 execute: ls /proc/41592 [2024-08-21 10:34:50.636] [DEBUG] -- exited code 0 [2024-08-21 10:34:50.637] [DEBUG] -- 192.168.20.71 is runnning, skip [2024-08-21 10:34:50.639] [DEBUG] -- root@192.168.20.103 execute: cat /home/root/oceanbase/run/observer.pid [2024-08-21 10:34:50.698] [DEBUG] -- exited code 0 [2024-08-21 10:34:50.698] [DEBUG] -- root@192.168.20.103 execute: ls /proc/65537 [2024-08-21 10:34:50.794] [DEBUG] -- exited code 0 [2024-08-21 10:34:50.795] [DEBUG] -- 192.168.20.103 is runnning, skip [2024-08-21 10:34:50.795] [DEBUG] -- root@192.168.20.71 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-08-21 10:34:50.850] [DEBUG] -- exited code 0 [2024-08-21 10:34:50.851] [DEBUG] -- root@192.168.20.71 execute: ulimit -a [2024-08-21 10:34:50.945] [DEBUG] -- exited code 0 [2024-08-21 10:34:50.946] [DEBUG] -- root@192.168.20.71 execute: cat /proc/meminfo [2024-08-21 10:34:51.043] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.044] [DEBUG] -- root@192.168.20.71 execute: df --block-size=1024 [2024-08-21 10:34:51.143] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.144] [DEBUG] -- get disk info for path /, total: 204952870912 avail: 46753050624 [2024-08-21 10:34:51.144] [DEBUG] -- get disk info for path /dev, total: 4194304 avail: 4194304 [2024-08-21 10:34:51.144] [DEBUG] -- get disk info for path /dev/shm, total: 16562208768 avail: 16562208768 [2024-08-21 10:34:51.145] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 4194304 avail: 4194304 [2024-08-21 10:34:51.145] [DEBUG] -- get disk info for path /run, total: 6624886784 avail: 6615797760 [2024-08-21 10:34:51.145] [DEBUG] -- get disk info for path /tmp, total: 16562208768 avail: 16443133952 [2024-08-21 10:34:51.145] [DEBUG] -- get disk info for path /boot, total: 1020702720 avail: 733515776 [2024-08-21 10:34:51.145] [DEBUG] -- disk: {'/': {'total': 204952870912, 'avail': 46753050624, 'need': 0}, '/dev': {'total': 4194304, 'avail': 4194304, 'need': 0}, '/dev/shm': {'total': 16562208768, 'avail': 16562208768, 'need': 0}, '/sys/fs/cgroup': {'total': 4194304, 'avail': 4194304, 'need': 0}, '/run': {'total': 6624886784, 'avail': 6615797760, 'need': 0}, '/tmp': {'total': 16562208768, 'avail': 16443133952, 'need': 0}, '/boot': {'total': 1020702720, 'avail': 733515776, 'need': 0}} [2024-08-21 10:34:51.145] [DEBUG] -- root@192.168.20.103 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-08-21 10:34:51.203] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.203] [DEBUG] -- root@192.168.20.103 execute: ulimit -a [2024-08-21 10:34:51.298] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.299] [DEBUG] -- root@192.168.20.103 execute: cat /proc/meminfo [2024-08-21 10:34:51.392] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.392] [DEBUG] -- root@192.168.20.103 execute: df --block-size=1024 [2024-08-21 10:34:51.489] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.490] [DEBUG] -- get disk info for path /, total: 204952870912 avail: 51962494976 [2024-08-21 10:34:51.490] [DEBUG] -- get disk info for path /dev, total: 4194304 avail: 4194304 [2024-08-21 10:34:51.490] [DEBUG] -- get disk info for path /dev/shm, total: 13391597568 avail: 13391597568 [2024-08-21 10:34:51.490] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 4194304 avail: 4194304 [2024-08-21 10:34:51.491] [DEBUG] -- get disk info for path /run, total: 5356642304 avail: 5347565568 [2024-08-21 10:34:51.491] [DEBUG] -- get disk info for path /tmp, total: 13391601664 avail: 13391601664 [2024-08-21 10:34:51.491] [DEBUG] -- get disk info for path /boot, total: 1020702720 avail: 733515776 [2024-08-21 10:34:51.491] [DEBUG] -- disk: {'/': {'total': 204952870912, 'avail': 51962494976, 'need': 0}, '/dev': {'total': 4194304, 'avail': 4194304, 'need': 0}, '/dev/shm': {'total': 13391597568, 'avail': 13391597568, 'need': 0}, '/sys/fs/cgroup': {'total': 4194304, 'avail': 4194304, 'need': 0}, '/run': {'total': 5356642304, 'avail': 5347565568, 'need': 0}, '/tmp': {'total': 13391601664, 'avail': 13391601664, 'need': 0}, '/boot': {'total': 1020702720, 'avail': 733515776, 'need': 0}} [2024-08-21 10:34:51.491] [DEBUG] -- root@192.168.20.71 execute: date +%s%N [2024-08-21 10:34:51.548] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.548] [DEBUG] -- 192.168.20.71 time delta -1.490478515625 [2024-08-21 10:34:51.548] [DEBUG] -- root@192.168.20.103 execute: date +%s%N [2024-08-21 10:34:51.603] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.603] [DEBUG] -- 192.168.20.103 time delta 0.990966796875 [2024-08-21 10:34:51.692] [DEBUG] - sub start_check ref count to 0 [2024-08-21 10:34:51.693] [DEBUG] - export start_check [2024-08-21 10:34:51.693] [DEBUG] - plugin oceanbase-ce-py_script_start_check-4.3.0.0 result: True [2024-08-21 10:34:51.693] [DEBUG] - Call obproxy-ce-py_script_start_check-4.2.3 for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:51.693] [DEBUG] - import start_check [2024-08-21 10:34:51.695] [DEBUG] - add start_check ref count to 1 [2024-08-21 10:34:51.696] [INFO] Check before start obproxy [2024-08-21 10:34:51.697] [DEBUG] -- root@192.168.20.71 execute: cat /home/root/obproxy/run/obproxy-192.168.20.71-2883.pid [2024-08-21 10:34:51.752] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.753] [DEBUG] -- root@192.168.20.71 execute: ls /proc/48946/fd [2024-08-21 10:34:51.845] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.845] [DEBUG] -- 192.168.20.71 is runnning, skip [2024-08-21 10:34:51.846] [DEBUG] -- root@192.168.20.103 execute: cat /home/root/obproxy/run/obproxy-192.168.20.103-2883.pid [2024-08-21 10:34:51.901] [DEBUG] -- exited code 0 [2024-08-21 10:34:51.901] [DEBUG] -- root@192.168.20.103 execute: ls /proc/69505/fd [2024-08-21 10:34:52.000] [DEBUG] -- exited code 0 [2024-08-21 10:34:52.001] [DEBUG] -- 192.168.20.103 is runnning, skip [2024-08-21 10:34:52.089] [DEBUG] - sub start_check ref count to 0 [2024-08-21 10:34:52.089] [DEBUG] - export start_check [2024-08-21 10:34:52.089] [DEBUG] - plugin obproxy-ce-py_script_start_check-4.2.3 result: True [2024-08-21 10:34:52.089] [DEBUG] - Call ocp-server-ce-py_script_start_check-4.2.2 for ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:52.089] [DEBUG] - import start_check [2024-08-21 10:34:52.095] [DEBUG] - add start_check ref count to 1 [2024-08-21 10:34:52.096] [INFO] Check before start ocp-server [2024-08-21 10:34:52.100] [DEBUG] -- oceanbase version check [2024-08-21 10:34:52.100] [DEBUG] -- root@192.168.20.71 execute: sudo -n true [2024-08-21 10:34:52.166] [DEBUG] -- exited code 0 [2024-08-21 10:34:52.167] [DEBUG] -- root@192.168.20.71 execute: sudo cat /home/root/ocp/run/ocp-server.pid [2024-08-21 10:34:52.269] [DEBUG] -- exited code 0 [2024-08-21 10:34:52.270] [DEBUG] -- root@192.168.20.71 execute: sudo ls /proc/45492 [2024-08-21 10:34:52.371] [DEBUG] -- exited code 2, error output: [2024-08-21 10:34:52.372] [DEBUG] ls: 无法访问 '/proc/45492': No such file or directory [2024-08-21 10:34:52.372] [DEBUG] [2024-08-21 10:34:52.372] [DEBUG] -- user check [2024-08-21 10:34:52.372] [DEBUG] -- root@192.168.20.71 execute: sudo id -u root [2024-08-21 10:34:52.474] [DEBUG] -- exited code 0 [2024-08-21 10:34:52.475] [DEBUG] -- port check [2024-08-21 10:34:52.475] [DEBUG] -- root@192.168.20.71 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':1F90' | awk -F' ' '{print $3}' | uniq [2024-08-21 10:34:52.573] [DEBUG] -- exited code 0 [2024-08-21 10:34:52.574] [DEBUG] -- java check [2024-08-21 10:34:52.574] [DEBUG] -- root@192.168.20.71 append '/home/root/ocp/jre/bin:' to PATH [2024-08-21 10:34:52.574] [DEBUG] -- root@192.168.20.71 execute: sudo java -version [2024-08-21 10:34:52.747] [DEBUG] -- exited code 0 [2024-08-21 10:34:52.748] [DEBUG] -- java version [2024-08-21 10:34:52.748] [DEBUG] -- java_major_version 1.8.0 [2024-08-21 10:34:52.748] [DEBUG] -- java_update_version 422 [2024-08-21 10:34:52.748] [DEBUG] -- clockdiff check [2024-08-21 10:34:52.748] [DEBUG] -- root@192.168.20.71 execute: clockdiff -o 127.0.0.1 [2024-08-21 10:34:52.842] [DEBUG] -- exited code 0 [2024-08-21 10:34:52.843] [DEBUG] -- memory check [2024-08-21 10:34:52.843] [DEBUG] -- root@192.168.20.71 execute: cat /proc/meminfo [2024-08-21 10:34:52.935] [DEBUG] -- exited code 0 [2024-08-21 10:34:52.936] [DEBUG] -- disk check [2024-08-21 10:34:52.936] [DEBUG] -- root@192.168.20.71 execute: sudo df --block-size=1024 [2024-08-21 10:34:53.038] [DEBUG] -- exited code 0 [2024-08-21 10:34:53.039] [DEBUG] -- get disk info for path /, total: 204952870912 avail: 46752800768 [2024-08-21 10:34:53.039] [DEBUG] -- get disk info for path /dev, total: 4194304 avail: 4194304 [2024-08-21 10:34:53.039] [DEBUG] -- get disk info for path /dev/shm, total: 16562208768 avail: 16562208768 [2024-08-21 10:34:53.039] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 4194304 avail: 4194304 [2024-08-21 10:34:53.039] [DEBUG] -- get disk info for path /run, total: 6624886784 avail: 6615797760 [2024-08-21 10:34:53.039] [DEBUG] -- get disk info for path /tmp, total: 16562208768 avail: 16443166720 [2024-08-21 10:34:53.039] [DEBUG] -- get disk info for path /boot, total: 1020702720 avail: 733515776 [2024-08-21 10:34:53.039] [DEBUG] -- root@192.168.20.71 execute: sudo df --block-size=1024 /home/root/logs [2024-08-21 10:34:53.142] [DEBUG] -- exited code 0 [2024-08-21 10:34:53.143] [DEBUG] -- get disk info for path /, total: 204952870912 avail: 46752788480 [2024-08-21 10:34:53.143] [DEBUG] -- root@192.168.20.71 execute: ls /home/root/ocp/.bootstrapped [2024-08-21 10:34:53.235] [DEBUG] -- exited code 2, error output: [2024-08-21 10:34:53.235] [DEBUG] ls: 无法访问 '/home/root/ocp/.bootstrapped': No such file or directory [2024-08-21 10:34:53.235] [DEBUG] [2024-08-21 10:34:53.270] [DEBUG] - sub start_check ref count to 0 [2024-08-21 10:34:53.270] [DEBUG] - export start_check [2024-08-21 10:34:53.270] [DEBUG] - plugin ocp-server-ce-py_script_start_check-4.2.2 result: True [2024-08-21 10:34:53.271] [DEBUG] - Call oceanbase-ce-py_script_start-4.3.0.0 for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:53.271] [DEBUG] - import start [2024-08-21 10:34:53.274] [DEBUG] - add start ref count to 1 [2024-08-21 10:34:53.275] [INFO] cluster scenario: htap [2024-08-21 10:34:53.275] [INFO] Start observer [2024-08-21 10:34:53.276] [DEBUG] -- root@192.168.20.71 execute: ls /data/1/clog/tenant_1/ [2024-08-21 10:34:53.330] [DEBUG] -- exited code 0 [2024-08-21 10:34:53.331] [DEBUG] -- root@192.168.20.71 execute: cat /home/root/oceanbase/run/observer.pid [2024-08-21 10:34:53.423] [DEBUG] -- exited code 0 [2024-08-21 10:34:53.424] [DEBUG] -- root@192.168.20.71 execute: ls /proc/41592 [2024-08-21 10:34:53.519] [DEBUG] -- exited code 0 [2024-08-21 10:34:53.519] [DEBUG] -- root@192.168.20.103 execute: ls /data/1/clog/tenant_1/ [2024-08-21 10:34:53.576] [DEBUG] -- exited code 0 [2024-08-21 10:34:53.576] [DEBUG] -- root@192.168.20.103 execute: cat /home/root/oceanbase/run/observer.pid [2024-08-21 10:34:53.672] [DEBUG] -- exited code 0 [2024-08-21 10:34:53.673] [DEBUG] -- root@192.168.20.103 execute: ls /proc/65537 [2024-08-21 10:34:53.770] [DEBUG] -- exited code 0 [2024-08-21 10:34:53.797] [DEBUG] -- start_obshell: True [2024-08-21 10:34:53.797] [DEBUG] -- root@192.168.20.71 execute: cat /home/root/oceanbase/run/obshell.pid [2024-08-21 10:34:53.850] [DEBUG] -- exited code 0 [2024-08-21 10:34:53.850] [DEBUG] -- root@192.168.20.71 execute: ls /proc/42588 [2024-08-21 10:34:53.942] [DEBUG] -- exited code 0 [2024-08-21 10:34:53.943] [DEBUG] -- 192.168.20.71 obshell[pid: 42588] started [2024-08-21 10:34:53.943] [DEBUG] -- root@192.168.20.103 execute: cat /home/root/oceanbase/run/obshell.pid [2024-08-21 10:34:54.000] [DEBUG] -- exited code 0 [2024-08-21 10:34:54.001] [DEBUG] -- root@192.168.20.103 execute: ls /proc/66493 [2024-08-21 10:34:54.096] [DEBUG] -- exited code 0 [2024-08-21 10:34:54.097] [DEBUG] -- 192.168.20.103 obshell[pid: 66493] started [2024-08-21 10:34:54.097] [INFO] observer program health check [2024-08-21 10:34:57.101] [DEBUG] -- 192.168.20.71 program health check [2024-08-21 10:34:57.101] [DEBUG] -- root@192.168.20.71 execute: cat /home/root/oceanbase/run/observer.pid [2024-08-21 10:34:57.154] [DEBUG] -- exited code 0 [2024-08-21 10:34:57.154] [DEBUG] -- root@192.168.20.71 execute: ls /proc/41592 [2024-08-21 10:34:57.245] [DEBUG] -- exited code 0 [2024-08-21 10:34:57.246] [DEBUG] -- 192.168.20.71 observer[pid: 41592] started [2024-08-21 10:34:57.246] [DEBUG] -- 192.168.20.103 program health check [2024-08-21 10:34:57.246] [DEBUG] -- root@192.168.20.103 execute: cat /home/root/oceanbase/run/observer.pid [2024-08-21 10:34:57.303] [DEBUG] -- exited code 0 [2024-08-21 10:34:57.303] [DEBUG] -- root@192.168.20.103 execute: ls /proc/65537 [2024-08-21 10:34:57.398] [DEBUG] -- exited code 0 [2024-08-21 10:34:57.398] [DEBUG] -- 192.168.20.103 observer[pid: 65537] started [2024-08-21 10:34:57.491] [INFO] obshell program health check [2024-08-21 10:34:57.492] [DEBUG] -- root@192.168.20.71 execute: cat /home/root/oceanbase/run/obshell.pid [2024-08-21 10:34:57.556] [DEBUG] -- exited code 0 [2024-08-21 10:34:57.556] [DEBUG] -- root@192.168.20.71 execute: ls /proc/42588 [2024-08-21 10:34:57.649] [DEBUG] -- exited code 0 [2024-08-21 10:34:57.649] [DEBUG] -- 192.168.20.71 obshell[pid: 42588] started [2024-08-21 10:34:57.650] [DEBUG] -- root@192.168.20.103 execute: cat /home/root/oceanbase/run/obshell.pid [2024-08-21 10:34:57.703] [DEBUG] -- exited code 0 [2024-08-21 10:34:57.704] [DEBUG] -- root@192.168.20.103 execute: ls /proc/66493 [2024-08-21 10:34:57.799] [DEBUG] -- exited code 0 [2024-08-21 10:34:57.800] [DEBUG] -- 192.168.20.103 obshell[pid: 66493] started [2024-08-21 10:34:57.883] [DEBUG] -- need_bootstrap: False [2024-08-21 10:34:57.883] [DEBUG] - sub start ref count to 0 [2024-08-21 10:34:57.883] [DEBUG] - export start [2024-08-21 10:34:57.883] [DEBUG] - plugin oceanbase-ce-py_script_start-4.3.0.0 result: True [2024-08-21 10:34:57.884] [DEBUG] - Call oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:34:57.884] [DEBUG] - import connect [2024-08-21 10:34:57.986] [DEBUG] - add connect ref count to 1 [2024-08-21 10:34:57.986] [DEBUG] -- connect obshell (192.168.20.71:2886) [2024-08-21 10:34:57.987] [DEBUG] -- connect obshell (192.168.20.103:2886) [2024-08-21 10:34:57.987] [INFO] Connect to observer [2024-08-21 10:34:57.988] [DEBUG] -- connect 192.168.20.71 -P2881 -uroot -pxf2024**AA [2024-08-21 10:34:57.990] [DEBUG] -- execute sql: select 1. args: None [2024-08-21 10:34:58.119] [DEBUG] - sub connect ref count to 0 [2024-08-21 10:34:58.119] [DEBUG] - export connect [2024-08-21 10:34:58.119] [DEBUG] - plugin oceanbase-ce-py_script_connect-4.2.2.0 result: True [2024-08-21 10:34:58.119] [DEBUG] - Call obproxy-ce-py_script_start-4.2.3 for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:58.119] [DEBUG] - import start [2024-08-21 10:34:58.122] [DEBUG] - add start ref count to 1 [2024-08-21 10:34:58.125] [INFO] Start obproxy [2024-08-21 10:34:58.126] [DEBUG] -- root@192.168.20.71 execute: ls /home/root/obproxy/etc/obproxy_config.bin [2024-08-21 10:34:58.182] [DEBUG] -- exited code 2, error output: [2024-08-21 10:34:58.182] [DEBUG] ls: 无法访问 '/home/root/obproxy/etc/obproxy_config.bin': No such file or directory [2024-08-21 10:34:58.182] [DEBUG] [2024-08-21 10:34:58.182] [DEBUG] -- 192.168.20.71 port check [2024-08-21 10:34:58.183] [DEBUG] -- root@192.168.20.71 execute: cat /home/root/obproxy/run/obproxy-192.168.20.71-2883.pid [2024-08-21 10:34:58.275] [DEBUG] -- exited code 0 [2024-08-21 10:34:58.275] [DEBUG] -- root@192.168.20.71 execute: ls /proc/48946/ [2024-08-21 10:34:58.367] [DEBUG] -- exited code 0 [2024-08-21 10:34:58.368] [DEBUG] -- root@192.168.20.71 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-08-21 10:34:58.465] [DEBUG] -- exited code 0 [2024-08-21 10:34:58.466] [DEBUG] -- 95229 [2024-08-21 10:34:58.466] [DEBUG] [2024-08-21 10:34:58.466] [DEBUG] -- root@192.168.20.71 execute: ls -l /proc/48946/fd/ |grep -E 'socket:\[(95229)\]' [2024-08-21 10:34:58.557] [DEBUG] -- exited code 0 [2024-08-21 10:34:58.558] [DEBUG] -- 192.168.20.103 port check [2024-08-21 10:34:58.558] [DEBUG] -- root@192.168.20.103 execute: cat /home/root/obproxy/run/obproxy-192.168.20.103-2883.pid [2024-08-21 10:34:58.611] [DEBUG] -- exited code 0 [2024-08-21 10:34:58.612] [DEBUG] -- root@192.168.20.103 execute: ls /proc/69505/ [2024-08-21 10:34:58.708] [DEBUG] -- exited code 0 [2024-08-21 10:34:58.708] [DEBUG] -- root@192.168.20.103 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-08-21 10:34:58.809] [DEBUG] -- exited code 0 [2024-08-21 10:34:58.810] [DEBUG] -- 126904 [2024-08-21 10:34:58.810] [DEBUG] [2024-08-21 10:34:58.810] [DEBUG] -- root@192.168.20.103 execute: ls -l /proc/69505/fd/ |grep -E 'socket:\[(126904)\]' [2024-08-21 10:34:58.906] [DEBUG] -- exited code 0 [2024-08-21 10:34:58.909] [INFO] obproxy program health check [2024-08-21 10:34:58.909] [DEBUG] -- 192.168.20.71 program health check [2024-08-21 10:34:58.910] [DEBUG] -- root@192.168.20.71 execute: cat /home/root/obproxy/run/obproxy-192.168.20.71-2883.pid [2024-08-21 10:34:58.967] [DEBUG] -- exited code 0 [2024-08-21 10:34:58.968] [DEBUG] -- root@192.168.20.71 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-08-21 10:34:59.064] [DEBUG] -- exited code 0 [2024-08-21 10:34:59.064] [DEBUG] -- 95229 [2024-08-21 10:34:59.065] [DEBUG] [2024-08-21 10:34:59.065] [DEBUG] -- root@192.168.20.71 execute: ls -l /proc/48946/fd/ |grep -E 'socket:\[(95229)\]' [2024-08-21 10:34:59.157] [DEBUG] -- exited code 0 [2024-08-21 10:34:59.157] [DEBUG] -- root@192.168.20.71 execute: pid=`cat /home/root/obproxy/run/obproxyd-192.168.20.71-2883.pid` && ls /proc/$pid [2024-08-21 10:34:59.252] [DEBUG] -- exited code 0 [2024-08-21 10:34:59.252] [DEBUG] -- 192.168.20.71 obproxy[pid: 48946] started [2024-08-21 10:34:59.253] [DEBUG] -- 192.168.20.103 program health check [2024-08-21 10:34:59.253] [DEBUG] -- root@192.168.20.103 execute: cat /home/root/obproxy/run/obproxy-192.168.20.103-2883.pid [2024-08-21 10:34:59.310] [DEBUG] -- exited code 0 [2024-08-21 10:34:59.310] [DEBUG] -- root@192.168.20.103 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-08-21 10:34:59.411] [DEBUG] -- exited code 0 [2024-08-21 10:34:59.412] [DEBUG] -- 126904 [2024-08-21 10:34:59.412] [DEBUG] [2024-08-21 10:34:59.412] [DEBUG] -- root@192.168.20.103 execute: ls -l /proc/69505/fd/ |grep -E 'socket:\[(126904)\]' [2024-08-21 10:34:59.507] [DEBUG] -- exited code 0 [2024-08-21 10:34:59.507] [DEBUG] -- root@192.168.20.103 execute: pid=`cat /home/root/obproxy/run/obproxyd-192.168.20.103-2883.pid` && ls /proc/$pid [2024-08-21 10:34:59.601] [DEBUG] -- exited code 0 [2024-08-21 10:34:59.601] [DEBUG] -- 192.168.20.103 obproxy[pid: 69505] started [2024-08-21 10:34:59.692] [DEBUG] - sub start ref count to 0 [2024-08-21 10:34:59.692] [DEBUG] - export start [2024-08-21 10:34:59.692] [DEBUG] - plugin obproxy-ce-py_script_start-4.2.3 result: True [2024-08-21 10:34:59.693] [DEBUG] - Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:59.693] [DEBUG] - import connect [2024-08-21 10:34:59.695] [DEBUG] - add connect ref count to 1 [2024-08-21 10:34:59.696] [INFO] Connect to obproxy [2024-08-21 10:34:59.698] [DEBUG] -- connect 192.168.20.71 -P2883 -uroot@proxysys -pxf2024**AA [2024-08-21 10:34:59.702] [DEBUG] -- connect 192.168.20.103 -P2883 -uroot@proxysys -pxf2024**AA [2024-08-21 10:34:59.829] [DEBUG] - sub connect ref count to 0 [2024-08-21 10:34:59.829] [DEBUG] - export connect [2024-08-21 10:34:59.829] [DEBUG] - plugin obproxy-ce-py_script_connect-3.1.0 result: True [2024-08-21 10:34:59.830] [INFO] Initialize obproxy-ce [2024-08-21 10:34:59.830] [DEBUG] - Call obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:34:59.830] [DEBUG] - import bootstrap [2024-08-21 10:34:59.831] [DEBUG] - add bootstrap ref count to 1 [2024-08-21 10:34:59.832] [DEBUG] -- execute sql: alter proxyconfig set observer_sys_password = %s. args: ['tDXCU2VGEv'] [2024-08-21 10:34:59.837] [DEBUG] -- execute sql: alter proxyconfig set observer_sys_password = %s. args: ['tDXCU2VGEv'] [2024-08-21 10:34:59.842] [DEBUG] - sub bootstrap ref count to 0 [2024-08-21 10:34:59.842] [DEBUG] - export bootstrap [2024-08-21 10:34:59.842] [DEBUG] - plugin obproxy-ce-py_script_bootstrap-3.1.0 result: True [2024-08-21 10:34:59.961] [DEBUG] - Call ocp-server-ce-py_script_start-4.2.1 for ocp-server-ce-4.3.1-20240805192406.el7-bd4512f9f708fb510d98f245b1be0b03a05e2cba [2024-08-21 10:34:59.961] [DEBUG] - import start [2024-08-21 10:34:59.966] [DEBUG] - add start ref count to 1 [2024-08-21 10:34:59.967] [DEBUG] -- metadb connect check [2024-08-21 10:34:59.967] [DEBUG] -- connect 192.168.20.71 -P2883 -uroot@ocp_meta -pxf2024**AA [2024-08-21 10:35:00.107] [ERROR] ocp-server-ce-py_script_start-4.2.1 RuntimeError: (1045, "Access denied for user 'root@ocp_meta'@'192.168.20.71' (using password: YES)") [2024-08-21 10:35:00.107] [ERROR] Traceback (most recent call last): [2024-08-21 10:35:00.107] [ERROR] File "core.py", line 2065, in start_cluster [2024-08-21 10:35:00.108] [ERROR] File "core.py", line 2159, in _start_cluster [2024-08-21 10:35:00.108] [ERROR] File "core.py", line 197, in call_plugin [2024-08-21 10:35:00.108] [ERROR] File "_plugin.py", line 348, in __call__ [2024-08-21 10:35:00.108] [ERROR] File "_plugin.py", line 305, in _new_func [2024-08-21 10:35:00.108] [ERROR] File "/root/.obd/plugins/ocp-server-ce/4.2.1/start.py", line 454, in start [2024-08-21 10:35:00.108] [ERROR] if not start_cluster(): [2024-08-21 10:35:00.108] [ERROR] File "/root/.obd/plugins/ocp-server-ce/4.2.1/start.py", line 237, in start_cluster [2024-08-21 10:35:00.108] [ERROR] meta_cursor = Cursor(jdbc_host, jdbc_port, meta_user, meta_tenant, meta_password, stdio) [2024-08-21 10:35:00.108] [ERROR] File "_stdio.py", line 912, in wrapper [2024-08-21 10:35:00.108] [ERROR] File "_stdio.py", line 899, in func_wrapper [2024-08-21 10:35:00.108] [ERROR] File "tool.py", line 766, in __init__ [2024-08-21 10:35:00.108] [ERROR] File "tool.py", line 796, in _connect [2024-08-21 10:35:00.108] [ERROR] File "pymysql/connections.py", line 353, in __init__ [2024-08-21 10:35:00.109] [ERROR] File "pymysql/connections.py", line 633, in connect [2024-08-21 10:35:00.109] [ERROR] File "pymysql/connections.py", line 907, in _request_authentication [2024-08-21 10:35:00.109] [ERROR] File "pymysql/connections.py", line 725, in _read_packet [2024-08-21 10:35:00.109] [ERROR] File "pymysql/protocol.py", line 221, in raise_for_error [2024-08-21 10:35:00.109] [ERROR] File "pymysql/err.py", line 143, in raise_mysql_exception [2024-08-21 10:35:00.109] [ERROR] pymysql.err.OperationalError: (1045, "Access denied for user 'root@ocp_meta'@'192.168.20.71' (using password: YES)") [2024-08-21 10:35:00.109] [ERROR] [2024-08-21 10:35:00.109] [DEBUG] - sub start ref count to 0 [2024-08-21 10:35:00.109] [DEBUG] - export start [2024-08-21 10:35:00.109] [DEBUG] - plugin ocp-server-ce-py_script_start-4.2.1 result: False [2024-08-21 10:35:00.109] [ERROR] ocp-server-ce start failed [2024-08-21 10:35:00.109] [DEBUG] - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.3.2.1-100000102024081217.el7-8f61ee3cb7c07eed1b2bd5be45085f2451411e96 [2024-08-21 10:35:00.109] [DEBUG] - import display [2024-08-21 10:35:00.111] [DEBUG] - add display ref count to 1 [2024-08-21 10:35:00.111] [INFO] Wait for observer init [2024-08-21 10:35:00.112] [DEBUG] -- execute sql: select * from oceanbase.__all_server. args: None [2024-08-21 10:35:00.115] [INFO] +--------------------------------------------------+ [2024-08-21 10:35:00.115] [INFO] | observer | [2024-08-21 10:35:00.116] [INFO] +----------------+---------+------+-------+--------+ [2024-08-21 10:35:00.116] [INFO] | ip | version | port | zone | status | [2024-08-21 10:35:00.116] [INFO] +----------------+---------+------+-------+--------+ [2024-08-21 10:35:00.116] [INFO] | 192.168.20.103 | 4.3.2.1 | 2881 | zone2 | ACTIVE | [2024-08-21 10:35:00.116] [INFO] | 192.168.20.71 | 4.3.2.1 | 2881 | zone1 | ACTIVE | [2024-08-21 10:35:00.116] [INFO] +----------------+---------+------+-------+--------+ [2024-08-21 10:35:00.116] [INFO] obclient -h192.168.20.103 -P2881 -uroot -p'xf2024**AA' -Doceanbase -A [2024-08-21 10:35:00.243] [INFO] +--------------------------------------------------+ [2024-08-21 10:35:00.243] [INFO] | observer | [2024-08-21 10:35:00.243] [INFO] +----------------+---------+------+-------+--------+ [2024-08-21 10:35:00.243] [INFO] | ip | version | port | zone | status | [2024-08-21 10:35:00.243] [INFO] +----------------+---------+------+-------+--------+ [2024-08-21 10:35:00.243] [INFO] | 192.168.20.103 | 4.3.2.1 | 2881 | zone2 | ACTIVE | [2024-08-21 10:35:00.243] [INFO] | 192.168.20.71 | 4.3.2.1 | 2881 | zone1 | ACTIVE | [2024-08-21 10:35:00.243] [INFO] +----------------+---------+------+-------+--------+ [2024-08-21 10:35:00.243] [INFO] obclient -h192.168.20.103 -P2881 -uroot -p'xf2024**AA' -Doceanbase -A [2024-08-21 10:35:00.243] [INFO] [2024-08-21 10:35:00.244] [DEBUG] -- execute sql: select unix_timestamp(gmt_create) as gmt_create from oceanbase.__all_virtual_sys_variable limit 1. args: None [2024-08-21 10:35:00.249] [INFO] cluster unique id: 54358466-369c-59c4-8888-f028c3537a8e-19172c138c0-01020304 [2024-08-21 10:35:00.249] [INFO] [2024-08-21 10:35:00.249] [DEBUG] - sub display ref count to 0 [2024-08-21 10:35:00.249] [DEBUG] - export display [2024-08-21 10:35:00.249] [DEBUG] - plugin oceanbase-ce-py_script_display-3.1.0 result: True [2024-08-21 10:35:00.249] [DEBUG] - Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.3.1.0-4.el7-835f4803c1f4da186439323b66c51db4662678a3 [2024-08-21 10:35:00.249] [DEBUG] - import display [2024-08-21 10:35:00.250] [DEBUG] - add display ref count to 1 [2024-08-21 10:35:00.251] [DEBUG] -- execute sql: show proxyconfig like "%port". args: None [2024-08-21 10:35:00.261] [DEBUG] -- execute sql: show proxyconfig like "%port". args: None [2024-08-21 10:35:00.271] [INFO] +--------------------------------------------------+ [2024-08-21 10:35:00.271] [INFO] | obproxy | [2024-08-21 10:35:00.271] [INFO] +----------------+------+-----------------+--------+ [2024-08-21 10:35:00.271] [INFO] | ip | port | prometheus_port | status | [2024-08-21 10:35:00.271] [INFO] +----------------+------+-----------------+--------+ [2024-08-21 10:35:00.271] [INFO] | 192.168.20.71 | 2883 | 2884 | active | [2024-08-21 10:35:00.271] [INFO] | 192.168.20.103 | 2883 | 2884 | active | [2024-08-21 10:35:00.271] [INFO] +----------------+------+-----------------+--------+ [2024-08-21 10:35:00.272] [INFO] obclient -h192.168.20.71 -P2883 -uroot@proxysys -p'xf2024**AA' -Doceanbase -A [2024-08-21 10:35:00.272] [INFO] [2024-08-21 10:35:00.272] [DEBUG] - sub display ref count to 0 [2024-08-21 10:35:00.273] [DEBUG] - export display [2024-08-21 10:35:00.273] [DEBUG] - plugin obproxy-ce-py_script_display-3.1.0 result: True [2024-08-21 10:35:00.276] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2024-08-21 10:35:00.276] [INFO] Trace ID: ef93f4c2-5f65-11ef-9963-5254000d58c3 [2024-08-21 10:35:00.276] [INFO] If you want to view detailed obd logs, please run: obd display-trace ef93f4c2-5f65-11ef-9963-5254000d58c3 [2024-08-21 10:35:00.277] [DEBUG] - unlock /root/.obd/lock/global [2024-08-21 10:35:00.277] [DEBUG] - unlock /root/.obd/lock/deploy_my [2024-08-21 10:35:00.277] [DEBUG] - unlock /root/.obd/lock/mirror_and_repo