``` [2024-12-09 14:47:25.444] [DEBUG] - Get deploy config [2024-12-09 14:47:25.444] [INFO] Search plugins [2024-12-09 14:47:25.444] [DEBUG] - Searching start_check plugin for components ... [2024-12-09 14:47:25.444] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:25.445] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.3.0.0 for oceanbase-ce-4.3.4.0 [2024-12-09 14:47:25.445] [DEBUG] - Searching start_check plugin for obproxy-ce-4.3.2.0-26.el7-fd779e401be448715254165b1a4f7205c4c1bda5 [2024-12-09 14:47:25.445] [DEBUG] - Found for obproxy-ce-py_script_start_check-4.3.0 for obproxy-ce-4.3.2.0 [2024-12-09 14:47:25.445] [DEBUG] - Searching create_tenant plugin for components ... [2024-12-09 14:47:25.445] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:25.446] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.3.0.0 for oceanbase-ce-4.3.4.0 [2024-12-09 14:47:25.446] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.3.2.0-26.el7-fd779e401be448715254165b1a4f7205c4c1bda5 [2024-12-09 14:47:25.447] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.3.2.0 [2024-12-09 14:47:25.447] [DEBUG] - Searching tenant_optimize plugin for components ... [2024-12-09 14:47:25.447] [DEBUG] - Searching tenant_optimize plugin for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:25.447] [DEBUG] - Found for oceanbase-ce-py_script_tenant_optimize-4.3.0.0 for oceanbase-ce-4.3.4.0 [2024-12-09 14:47:25.448] [DEBUG] - Searching tenant_optimize plugin for obproxy-ce-4.3.2.0-26.el7-fd779e401be448715254165b1a4f7205c4c1bda5 [2024-12-09 14:47:25.448] [DEBUG] - No such tenant_optimize plugin for obproxy-ce-4.3.2.0 [2024-12-09 14:47:25.448] [DEBUG] - Searching start plugin for components ... [2024-12-09 14:47:25.448] [DEBUG] - Searching start plugin for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:25.449] [DEBUG] - Found for oceanbase-ce-py_script_start-4.3.0.0 for oceanbase-ce-4.3.4.0 [2024-12-09 14:47:25.449] [DEBUG] - Searching start plugin for obproxy-ce-4.3.2.0-26.el7-fd779e401be448715254165b1a4f7205c4c1bda5 [2024-12-09 14:47:25.449] [DEBUG] - Found for obproxy-ce-py_script_start-4.3.0 for obproxy-ce-4.3.2.0 [2024-12-09 14:47:25.450] [DEBUG] - Searching connect plugin for components ... [2024-12-09 14:47:25.450] [DEBUG] - Searching connect plugin for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:25.451] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.4.0 [2024-12-09 14:47:25.451] [DEBUG] - Searching connect plugin for obproxy-ce-4.3.2.0-26.el7-fd779e401be448715254165b1a4f7205c4c1bda5 [2024-12-09 14:47:25.451] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.3.2.0 [2024-12-09 14:47:25.451] [DEBUG] - Searching bootstrap plugin for components ... [2024-12-09 14:47:25.451] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:25.452] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.2.2.0 for oceanbase-ce-4.3.4.0 [2024-12-09 14:47:25.452] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.3.2.0-26.el7-fd779e401be448715254165b1a4f7205c4c1bda5 [2024-12-09 14:47:25.452] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.3.2.0 [2024-12-09 14:47:25.453] [DEBUG] - Searching display plugin for components ... [2024-12-09 14:47:25.453] [DEBUG] - Searching display plugin for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:25.453] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.3.4.0 [2024-12-09 14:47:25.454] [DEBUG] - Searching display plugin for obproxy-ce-4.3.2.0-26.el7-fd779e401be448715254165b1a4f7205c4c1bda5 [2024-12-09 14:47:25.454] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.3.2.0 [2024-12-09 14:47:25.454] [INFO] Load cluster param plugin [2024-12-09 14:47:25.454] [DEBUG] - Get local repository oceanbase-ce-4.3.4.0-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:25.455] [DEBUG] - Get local repository obproxy-ce-4.3.2.0-fd779e401be448715254165b1a4f7205c4c1bda5 [2024-12-09 14:47:25.455] [DEBUG] - Searching param plugin for components ... [2024-12-09 14:47:25.455] [DEBUG] - Search param plugin for oceanbase-ce [2024-12-09 14:47:25.455] [DEBUG] - Found for oceanbase-ce-param-4.3.3.0 for oceanbase-ce-4.3.4.0 [2024-12-09 14:47:25.455] [DEBUG] - Applying oceanbase-ce-param-4.3.3.0 for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:25.456] [DEBUG] - Search param plugin for obproxy-ce [2024-12-09 14:47:25.456] [DEBUG] - Found for obproxy-ce-param-4.3.0 for obproxy-ce-4.3.2.0 [2024-12-09 14:47:25.456] [DEBUG] - Applying obproxy-ce-param-4.3.0 for obproxy-ce-4.3.2.0-26.el7-fd779e401be448715254165b1a4f7205c4c1bda5 [2024-12-09 14:47:25.457] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.3.0.0 for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:25.457] [INFO] Check before start observer [2024-12-09 14:47:25.459] [DEBUG] -- root@192.168.124.46 execute: ls /data/myoceanbase/oceanbase/store/clog/tenant_1/ [2024-12-09 14:47:25.522] [DEBUG] -- exited code 2, error output: [2024-12-09 14:47:25.522] [DEBUG] ls: cannot access '/data/myoceanbase/oceanbase/store/clog/tenant_1/': No such file or directory [2024-12-09 14:47:25.522] [DEBUG] [2024-12-09 14:47:25.523] [DEBUG] -- root@192.168.124.46 execute: cat /root/myoceanbase/oceanbase/run/observer.pid [2024-12-09 14:47:25.625] [DEBUG] -- exited code 1, error output: [2024-12-09 14:47:25.625] [DEBUG] cat: /root/myoceanbase/oceanbase/run/observer.pid: No such file or directory [2024-12-09 14:47:25.625] [DEBUG] [2024-12-09 14:47:25.625] [DEBUG] -- 192.168.124.46 port check [2024-12-09 14:47:25.625] [DEBUG] -- root@192.168.124.46 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B41' | awk -F' ' '{print $3}' | uniq [2024-12-09 14:47:25.734] [DEBUG] -- exited code 0 [2024-12-09 14:47:25.735] [DEBUG] -- root@192.168.124.46 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B42' | awk -F' ' '{print $3}' | uniq [2024-12-09 14:47:25.844] [DEBUG] -- exited code 0 [2024-12-09 14:47:25.844] [DEBUG] -- root@192.168.124.46 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B46' | awk -F' ' '{print $3}' | uniq [2024-12-09 14:47:25.954] [DEBUG] -- exited code 0 [2024-12-09 14:47:25.955] [DEBUG] -- root@192.168.124.46 execute: ls /data/myoceanbase/oceanbase/store/sstable/block_file [2024-12-09 14:47:26.062] [DEBUG] -- exited code 2, error output: [2024-12-09 14:47:26.062] [DEBUG] ls: cannot access '/data/myoceanbase/oceanbase/store/sstable/block_file': No such file or directory [2024-12-09 14:47:26.063] [DEBUG] [2024-12-09 14:47:26.064] [DEBUG] -- root@192.168.124.49 execute: ls /data/myoceanbase/oceanbase/store/clog/tenant_1/ [2024-12-09 14:47:26.133] [DEBUG] -- exited code 2, error output: [2024-12-09 14:47:26.134] [DEBUG] ls: cannot access '/data/myoceanbase/oceanbase/store/clog/tenant_1/': No such file or directory [2024-12-09 14:47:26.134] [DEBUG] [2024-12-09 14:47:26.134] [DEBUG] -- root@192.168.124.49 execute: cat /root/myoceanbase/oceanbase/run/observer.pid [2024-12-09 14:47:26.240] [DEBUG] -- exited code 1, error output: [2024-12-09 14:47:26.240] [DEBUG] cat: /root/myoceanbase/oceanbase/run/observer.pid: No such file or directory [2024-12-09 14:47:26.240] [DEBUG] [2024-12-09 14:47:26.241] [DEBUG] -- 192.168.124.49 port check [2024-12-09 14:47:26.241] [DEBUG] -- root@192.168.124.49 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B41' | awk -F' ' '{print $3}' | uniq [2024-12-09 14:47:26.350] [DEBUG] -- exited code 0 [2024-12-09 14:47:26.350] [DEBUG] -- root@192.168.124.49 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B42' | awk -F' ' '{print $3}' | uniq [2024-12-09 14:47:26.460] [DEBUG] -- exited code 0 [2024-12-09 14:47:26.461] [DEBUG] -- root@192.168.124.49 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B46' | awk -F' ' '{print $3}' | uniq [2024-12-09 14:47:26.570] [DEBUG] -- exited code 0 [2024-12-09 14:47:26.571] [DEBUG] -- root@192.168.124.49 execute: ls /data/myoceanbase/oceanbase/store/sstable/block_file [2024-12-09 14:47:26.676] [DEBUG] -- exited code 2, error output: [2024-12-09 14:47:26.676] [DEBUG] ls: cannot access '/data/myoceanbase/oceanbase/store/sstable/block_file': No such file or directory [2024-12-09 14:47:26.676] [DEBUG] [2024-12-09 14:47:26.678] [DEBUG] -- root@192.168.124.52 execute: ls /data/myoceanbase/oceanbase/store/clog/tenant_1/ [2024-12-09 14:47:26.743] [DEBUG] -- exited code 2, error output: [2024-12-09 14:47:26.743] [DEBUG] ls: cannot access '/data/myoceanbase/oceanbase/store/clog/tenant_1/': No such file or directory [2024-12-09 14:47:26.743] [DEBUG] [2024-12-09 14:47:26.744] [DEBUG] -- root@192.168.124.52 execute: cat /root/myoceanbase/oceanbase/run/observer.pid [2024-12-09 14:47:26.845] [DEBUG] -- exited code 1, error output: [2024-12-09 14:47:26.846] [DEBUG] cat: /root/myoceanbase/oceanbase/run/observer.pid: No such file or directory [2024-12-09 14:47:26.846] [DEBUG] [2024-12-09 14:47:26.846] [DEBUG] -- 192.168.124.52 port check [2024-12-09 14:47:26.846] [DEBUG] -- root@192.168.124.52 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B41' | awk -F' ' '{print $3}' | uniq [2024-12-09 14:47:26.954] [DEBUG] -- exited code 0 [2024-12-09 14:47:26.955] [DEBUG] -- root@192.168.124.52 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B42' | awk -F' ' '{print $3}' | uniq [2024-12-09 14:47:27.063] [DEBUG] -- exited code 0 [2024-12-09 14:47:27.064] [DEBUG] -- root@192.168.124.52 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':0B46' | awk -F' ' '{print $3}' | uniq [2024-12-09 14:47:27.173] [DEBUG] -- exited code 0 [2024-12-09 14:47:27.173] [DEBUG] -- root@192.168.124.52 execute: ls /data/myoceanbase/oceanbase/store/sstable/block_file [2024-12-09 14:47:27.276] [DEBUG] -- exited code 2, error output: [2024-12-09 14:47:27.277] [DEBUG] ls: cannot access '/data/myoceanbase/oceanbase/store/sstable/block_file': No such file or directory [2024-12-09 14:47:27.277] [DEBUG] [2024-12-09 14:47:27.277] [DEBUG] -- root@192.168.124.46 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-12-09 14:47:27.344] [DEBUG] -- exited code 0 [2024-12-09 14:47:27.344] [DEBUG] -- root@192.168.124.46 execute: ulimit -a [2024-12-09 14:47:27.447] [DEBUG] -- exited code 0 [2024-12-09 14:47:27.453] [DEBUG] -- root@192.168.124.46 execute: sysctl -a [2024-12-09 14:47:27.571] [DEBUG] -- exited code 0 [2024-12-09 14:47:27.574] [DEBUG] -- root@192.168.124.46 execute: cat /proc/meminfo [2024-12-09 14:47:27.676] [DEBUG] -- exited code 0 [2024-12-09 14:47:27.677] [DEBUG] -- root@192.168.124.46 execute: df --block-size=1024 [2024-12-09 14:47:27.781] [DEBUG] -- exited code 0 [2024-12-09 14:47:27.781] [DEBUG] -- get disk info for path /, total: 115658190848 avail: 105058480128 [2024-12-09 14:47:27.781] [DEBUG] -- get disk info for path /dev, total: 4194304 avail: 4194304 [2024-12-09 14:47:27.782] [DEBUG] -- get disk info for path /dev/shm, total: 8098578432 avail: 8098578432 [2024-12-09 14:47:27.782] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 4194304 avail: 4194304 [2024-12-09 14:47:27.782] [DEBUG] -- get disk info for path /sys/firmware/efi/efivars, total: 262144 avail: 214016 [2024-12-09 14:47:27.782] [DEBUG] -- get disk info for path /run, total: 3239432192 avail: 3230306304 [2024-12-09 14:47:27.782] [DEBUG] -- get disk info for path /tmp, total: 8098578432 avail: 8098578432 [2024-12-09 14:47:27.782] [DEBUG] -- get disk info for path /boot, total: 1020702720 avail: 689786880 [2024-12-09 14:47:27.782] [DEBUG] -- get disk info for path /home, total: 8928030720 avail: 8452374528 [2024-12-09 14:47:27.782] [DEBUG] -- get disk info for path /boot/efi, total: 627875840 avail: 621522944 [2024-12-09 14:47:27.782] [DEBUG] -- root@192.168.124.46 execute: df --block-size=1024 /data/myoceanbase/oceanbase/store/clog [2024-12-09 14:47:27.887] [DEBUG] -- exited code 0 [2024-12-09 14:47:27.888] [DEBUG] -- get disk info for path /, total: 115658190848 avail: 105058480128 [2024-12-09 14:47:27.888] [DEBUG] -- root@192.168.124.46 execute: df --block-size=1024 /data/myoceanbase/oceanbase/store [2024-12-09 14:47:27.991] [DEBUG] -- exited code 0 [2024-12-09 14:47:27.991] [DEBUG] -- get disk info for path /, total: 115658190848 avail: 105058476032 [2024-12-09 14:47:27.992] [DEBUG] -- disk: {'/': {'total': 115658190848, 'avail': 105058476032, 'need': 0}, '/dev': {'total': 4194304, 'avail': 4194304, 'need': 0}, '/dev/shm': {'total': 8098578432, 'avail': 8098578432, 'need': 0}, '/sys/fs/cgroup': {'total': 4194304, 'avail': 4194304, 'need': 0}, '/sys/firmware/efi/efivars': {'total': 262144, 'avail': 214016, 'need': 0}, '/run': {'total': 3239432192, 'avail': 3230306304, 'need': 0}, '/tmp': {'total': 8098578432, 'avail': 8098578432, 'need': 0}, '/boot': {'total': 1020702720, 'avail': 689786880, 'need': 0}, '/home': {'total': 8928030720, 'avail': 8452374528, 'need': 0}, '/boot/efi': {'total': 627875840, 'avail': 621522944, 'need': 0}} [2024-12-09 14:47:27.992] [WARNING] OBD-1012: (192.168.124.46) clog and data use the same disk (/) [2024-12-09 14:47:27.992] [DEBUG] -- root@192.168.124.49 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-12-09 14:47:28.055] [DEBUG] -- exited code 0 [2024-12-09 14:47:28.055] [DEBUG] -- root@192.168.124.49 execute: ulimit -a [2024-12-09 14:47:28.157] [DEBUG] -- exited code 0 [2024-12-09 14:47:28.158] [DEBUG] -- root@192.168.124.49 execute: sysctl -a [2024-12-09 14:47:28.281] [DEBUG] -- exited code 0 [2024-12-09 14:47:28.285] [DEBUG] -- root@192.168.124.49 execute: cat /proc/meminfo [2024-12-09 14:47:28.384] [DEBUG] -- exited code 0 [2024-12-09 14:47:28.385] [DEBUG] -- root@192.168.124.49 execute: df --block-size=1024 [2024-12-09 14:47:28.489] [DEBUG] -- exited code 0 [2024-12-09 14:47:28.489] [DEBUG] -- get disk info for path /, total: 115658190848 avail: 106788724736 [2024-12-09 14:47:28.490] [DEBUG] -- get disk info for path /dev, total: 4194304 avail: 4194304 [2024-12-09 14:47:28.490] [DEBUG] -- get disk info for path /dev/shm, total: 8098578432 avail: 8098578432 [2024-12-09 14:47:28.490] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 4194304 avail: 4194304 [2024-12-09 14:47:28.490] [DEBUG] -- get disk info for path /sys/firmware/efi/efivars, total: 262144 avail: 214016 [2024-12-09 14:47:28.490] [DEBUG] -- get disk info for path /run, total: 3239432192 avail: 3230306304 [2024-12-09 14:47:28.490] [DEBUG] -- get disk info for path /tmp, total: 8098578432 avail: 8098578432 [2024-12-09 14:47:28.490] [DEBUG] -- get disk info for path /boot, total: 1020702720 avail: 689786880 [2024-12-09 14:47:28.490] [DEBUG] -- get disk info for path /home, total: 8928030720 avail: 8452374528 [2024-12-09 14:47:28.490] [DEBUG] -- get disk info for path /boot/efi, total: 627875840 avail: 621522944 [2024-12-09 14:47:28.490] [DEBUG] -- root@192.168.124.49 execute: df --block-size=1024 /data/myoceanbase/oceanbase/store/clog [2024-12-09 14:47:28.593] [DEBUG] -- exited code 0 [2024-12-09 14:47:28.593] [DEBUG] -- get disk info for path /, total: 115658190848 avail: 106788720640 [2024-12-09 14:47:28.594] [DEBUG] -- root@192.168.124.49 execute: df --block-size=1024 /data/myoceanbase/oceanbase/store [2024-12-09 14:47:28.695] [DEBUG] -- exited code 0 [2024-12-09 14:47:28.696] [DEBUG] -- get disk info for path /, total: 115658190848 avail: 106788720640 [2024-12-09 14:47:28.696] [DEBUG] -- disk: {'/': {'total': 115658190848, 'avail': 106788720640, 'need': 0}, '/dev': {'total': 4194304, 'avail': 4194304, 'need': 0}, '/dev/shm': {'total': 8098578432, 'avail': 8098578432, 'need': 0}, '/sys/fs/cgroup': {'total': 4194304, 'avail': 4194304, 'need': 0}, '/sys/firmware/efi/efivars': {'total': 262144, 'avail': 214016, 'need': 0}, '/run': {'total': 3239432192, 'avail': 3230306304, 'need': 0}, '/tmp': {'total': 8098578432, 'avail': 8098578432, 'need': 0}, '/boot': {'total': 1020702720, 'avail': 689786880, 'need': 0}, '/home': {'total': 8928030720, 'avail': 8452374528, 'need': 0}, '/boot/efi': {'total': 627875840, 'avail': 621522944, 'need': 0}} [2024-12-09 14:47:28.696] [WARNING] OBD-1012: (192.168.124.49) clog and data use the same disk (/) [2024-12-09 14:47:28.696] [DEBUG] -- root@192.168.124.52 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-12-09 14:47:28.760] [DEBUG] -- exited code 0 [2024-12-09 14:47:28.760] [DEBUG] -- root@192.168.124.52 execute: ulimit -a [2024-12-09 14:47:28.861] [DEBUG] -- exited code 0 [2024-12-09 14:47:28.862] [DEBUG] -- root@192.168.124.52 execute: sysctl -a [2024-12-09 14:47:28.986] [DEBUG] -- exited code 0 [2024-12-09 14:47:28.990] [DEBUG] -- root@192.168.124.52 execute: cat /proc/meminfo [2024-12-09 14:47:29.092] [DEBUG] -- exited code 0 [2024-12-09 14:47:29.093] [DEBUG] -- root@192.168.124.52 execute: df --block-size=1024 [2024-12-09 14:47:29.202] [DEBUG] -- exited code 0 [2024-12-09 14:47:29.202] [DEBUG] -- get disk info for path /, total: 115658190848 avail: 106786852864 [2024-12-09 14:47:29.202] [DEBUG] -- get disk info for path /dev, total: 4194304 avail: 4194304 [2024-12-09 14:47:29.202] [DEBUG] -- get disk info for path /dev/shm, total: 8098570240 avail: 8098570240 [2024-12-09 14:47:29.202] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 4194304 avail: 4194304 [2024-12-09 14:47:29.203] [DEBUG] -- get disk info for path /sys/firmware/efi/efivars, total: 262144 avail: 214016 [2024-12-09 14:47:29.203] [DEBUG] -- get disk info for path /run, total: 3239428096 avail: 3230302208 [2024-12-09 14:47:29.203] [DEBUG] -- get disk info for path /tmp, total: 8098570240 avail: 8098570240 [2024-12-09 14:47:29.203] [DEBUG] -- get disk info for path /boot, total: 1020702720 avail: 689692672 [2024-12-09 14:47:29.203] [DEBUG] -- get disk info for path /home, total: 8928030720 avail: 8452374528 [2024-12-09 14:47:29.203] [DEBUG] -- get disk info for path /boot/efi, total: 627875840 avail: 621522944 [2024-12-09 14:47:29.203] [DEBUG] -- root@192.168.124.52 execute: df --block-size=1024 /data/myoceanbase/oceanbase/store/clog [2024-12-09 14:47:29.306] [DEBUG] -- exited code 0 [2024-12-09 14:47:29.307] [DEBUG] -- get disk info for path /, total: 115658190848 avail: 106786848768 [2024-12-09 14:47:29.307] [DEBUG] -- root@192.168.124.52 execute: df --block-size=1024 /data/myoceanbase/oceanbase/store [2024-12-09 14:47:29.414] [DEBUG] -- exited code 0 [2024-12-09 14:47:29.414] [DEBUG] -- get disk info for path /, total: 115658190848 avail: 106786848768 [2024-12-09 14:47:29.415] [DEBUG] -- disk: {'/': {'total': 115658190848, 'avail': 106786848768, 'need': 0}, '/dev': {'total': 4194304, 'avail': 4194304, 'need': 0}, '/dev/shm': {'total': 8098570240, 'avail': 8098570240, 'need': 0}, '/sys/fs/cgroup': {'total': 4194304, 'avail': 4194304, 'need': 0}, '/sys/firmware/efi/efivars': {'total': 262144, 'avail': 214016, 'need': 0}, '/run': {'total': 3239428096, 'avail': 3230302208, 'need': 0}, '/tmp': {'total': 8098570240, 'avail': 8098570240, 'need': 0}, '/boot': {'total': 1020702720, 'avail': 689692672, 'need': 0}, '/home': {'total': 8928030720, 'avail': 8452374528, 'need': 0}, '/boot/efi': {'total': 627875840, 'avail': 621522944, 'need': 0}} [2024-12-09 14:47:29.415] [WARNING] OBD-1012: (192.168.124.52) clog and data use the same disk (/) [2024-12-09 14:47:29.415] [DEBUG] -- root@192.168.124.46 execute: ping -W 1 -c 1 127.0.0.1 [2024-12-09 14:47:29.480] [DEBUG] -- exited code 0 [2024-12-09 14:47:29.480] [DEBUG] -- root@192.168.124.46 execute: ping -W 1 -c 1 192.168.124.49 [2024-12-09 14:47:29.585] [DEBUG] -- exited code 0 [2024-12-09 14:47:29.585] [DEBUG] -- root@192.168.124.46 execute: ping -W 1 -c 1 192.168.124.52 [2024-12-09 14:47:29.691] [DEBUG] -- exited code 0 [2024-12-09 14:47:29.692] [DEBUG] -- root@192.168.124.49 execute: ping -W 1 -c 1 127.0.0.1 [2024-12-09 14:47:29.757] [DEBUG] -- exited code 0 [2024-12-09 14:47:29.757] [DEBUG] -- root@192.168.124.49 execute: ping -W 1 -c 1 192.168.124.46 [2024-12-09 14:47:29.862] [DEBUG] -- exited code 0 [2024-12-09 14:47:29.863] [DEBUG] -- root@192.168.124.49 execute: ping -W 1 -c 1 192.168.124.52 [2024-12-09 14:47:29.970] [DEBUG] -- exited code 0 [2024-12-09 14:47:29.970] [DEBUG] -- root@192.168.124.52 execute: ping -W 1 -c 1 127.0.0.1 [2024-12-09 14:47:30.035] [DEBUG] -- exited code 0 [2024-12-09 14:47:30.036] [DEBUG] -- root@192.168.124.52 execute: ping -W 1 -c 1 192.168.124.46 [2024-12-09 14:47:30.139] [DEBUG] -- exited code 0 [2024-12-09 14:47:30.140] [DEBUG] -- root@192.168.124.52 execute: ping -W 1 -c 1 192.168.124.49 [2024-12-09 14:47:30.242] [DEBUG] -- exited code 0 [2024-12-09 14:47:30.243] [DEBUG] -- root@192.168.124.46 execute: date +%s%N [2024-12-09 14:47:30.306] [DEBUG] -- exited code 0 [2024-12-09 14:47:30.307] [DEBUG] -- 192.168.124.46 time delta 27.309326171875 [2024-12-09 14:47:30.307] [DEBUG] -- root@192.168.124.49 execute: date +%s%N [2024-12-09 14:47:30.370] [DEBUG] -- exited code 0 [2024-12-09 14:47:30.371] [DEBUG] -- 192.168.124.49 time delta 30.172607421875 [2024-12-09 14:47:30.371] [DEBUG] -- root@192.168.124.52 execute: date +%s%N [2024-12-09 14:47:30.434] [DEBUG] -- exited code 0 [2024-12-09 14:47:30.435] [DEBUG] -- 192.168.124.52 time delta 31.219970703125 [2024-12-09 14:47:30.435] [INFO] [WARN] OBD-1012: (192.168.124.46) clog and data use the same disk (/) [2024-12-09 14:47:30.435] [INFO] [WARN] OBD-1012: (192.168.124.49) clog and data use the same disk (/) [2024-12-09 14:47:30.435] [INFO] [WARN] OBD-1012: (192.168.124.52) clog and data use the same disk (/) [2024-12-09 14:47:30.435] [INFO] [2024-12-09 14:47:30.436] [DEBUG] - plugin oceanbase-ce-py_script_start_check-4.3.0.0 result: True [2024-12-09 14:47:30.436] [DEBUG] - Call oceanbase-ce-py_script_start-4.3.0.0 for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:30.436] [DEBUG] - import start [2024-12-09 14:47:30.450] [DEBUG] - add start ref count to 1 [2024-12-09 14:47:30.451] [INFO] cluster scenario: htap [2024-12-09 14:47:30.451] [INFO] Start observer [2024-12-09 14:47:30.452] [DEBUG] -- root@192.168.124.46 execute: ls /data/myoceanbase/oceanbase/store/clog/tenant_1/ [2024-12-09 14:47:30.517] [DEBUG] -- exited code 2, error output: [2024-12-09 14:47:30.518] [DEBUG] ls: cannot access '/data/myoceanbase/oceanbase/store/clog/tenant_1/': No such file or directory [2024-12-09 14:47:30.518] [DEBUG] [2024-12-09 14:47:30.518] [DEBUG] -- root@192.168.124.46 execute: cat /root/myoceanbase/oceanbase/run/observer.pid [2024-12-09 14:47:30.621] [DEBUG] -- exited code 1, error output: [2024-12-09 14:47:30.621] [DEBUG] cat: /root/myoceanbase/oceanbase/run/observer.pid: No such file or directory [2024-12-09 14:47:30.621] [DEBUG] [2024-12-09 14:47:30.621] [DEBUG] -- 192.168.124.46 start command construction [2024-12-09 14:47:30.621] [DEBUG] -- update large_query_threshold to 600s because of scenario [2024-12-09 14:47:30.621] [DEBUG] -- update enable_record_trace_log to False because of scenario [2024-12-09 14:47:30.621] [DEBUG] -- update enable_syslog_recycle to 1 because of scenario [2024-12-09 14:47:30.622] [DEBUG] -- update max_syslog_file_count to 300 because of scenario [2024-12-09 14:47:30.622] [DEBUG] -- root@192.168.124.49 execute: ls /data/myoceanbase/oceanbase/store/clog/tenant_1/ [2024-12-09 14:47:30.687] [DEBUG] -- exited code 2, error output: [2024-12-09 14:47:30.688] [DEBUG] ls: cannot access '/data/myoceanbase/oceanbase/store/clog/tenant_1/': No such file or directory [2024-12-09 14:47:30.688] [DEBUG] [2024-12-09 14:47:30.688] [DEBUG] -- root@192.168.124.49 execute: cat /root/myoceanbase/oceanbase/run/observer.pid [2024-12-09 14:47:30.790] [DEBUG] -- exited code 1, error output: [2024-12-09 14:47:30.790] [DEBUG] cat: /root/myoceanbase/oceanbase/run/observer.pid: No such file or directory [2024-12-09 14:47:30.790] [DEBUG] [2024-12-09 14:47:30.790] [DEBUG] -- 192.168.124.49 start command construction [2024-12-09 14:47:30.790] [DEBUG] -- update large_query_threshold to 600s because of scenario [2024-12-09 14:47:30.790] [DEBUG] -- update enable_record_trace_log to False because of scenario [2024-12-09 14:47:30.790] [DEBUG] -- update enable_syslog_recycle to 1 because of scenario [2024-12-09 14:47:30.790] [DEBUG] -- update max_syslog_file_count to 300 because of scenario [2024-12-09 14:47:30.791] [DEBUG] -- root@192.168.124.52 execute: ls /data/myoceanbase/oceanbase/store/clog/tenant_1/ [2024-12-09 14:47:30.854] [DEBUG] -- exited code 2, error output: [2024-12-09 14:47:30.854] [DEBUG] ls: cannot access '/data/myoceanbase/oceanbase/store/clog/tenant_1/': No such file or directory [2024-12-09 14:47:30.855] [DEBUG] [2024-12-09 14:47:30.855] [DEBUG] -- root@192.168.124.52 execute: cat /root/myoceanbase/oceanbase/run/observer.pid [2024-12-09 14:47:30.957] [DEBUG] -- exited code 1, error output: [2024-12-09 14:47:30.958] [DEBUG] cat: /root/myoceanbase/oceanbase/run/observer.pid: No such file or directory [2024-12-09 14:47:30.958] [DEBUG] [2024-12-09 14:47:30.958] [DEBUG] -- 192.168.124.52 start command construction [2024-12-09 14:47:30.958] [DEBUG] -- update large_query_threshold to 600s because of scenario [2024-12-09 14:47:30.958] [DEBUG] -- update enable_record_trace_log to False because of scenario [2024-12-09 14:47:30.958] [DEBUG] -- update enable_syslog_recycle to 1 because of scenario [2024-12-09 14:47:30.958] [DEBUG] -- update max_syslog_file_count to 300 because of scenario [2024-12-09 14:47:30.959] [DEBUG] -- starting 192.168.124.46 observer [2024-12-09 14:47:30.959] [DEBUG] -- root@192.168.124.46 export LD_LIBRARY_PATH='/root/myoceanbase/oceanbase/lib:' [2024-12-09 14:47:30.959] [DEBUG] -- root@192.168.124.46 execute: cd /root/myoceanbase/oceanbase; /root/myoceanbase/oceanbase/bin/observer -r '192.168.124.46:2882:2881;192.168.124.49:2882:2881;192.168.124.52:2882:2881' -p 2881 -P 2882 -z 'zone1' -n 'myoceanbase' -c 1733726289 -d '/data/myoceanbase/oceanbase/store' -I '192.168.124.46' -o __min_full_resource_pool_memory=2147483648,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit='10G',datafile_size='25G',system_memory='3G',log_disk_size='25G',cpu_count=16,datafile_maxsize='63G',datafile_next='6G',large_query_threshold='600s',enable_record_trace_log=False,enable_syslog_recycle=1 [2024-12-09 14:47:31.219] [DEBUG] -- exited code 0 [2024-12-09 14:47:31.219] [DEBUG] -- root@192.168.124.46 export LD_LIBRARY_PATH='' [2024-12-09 14:47:31.273] [DEBUG] -- starting 192.168.124.49 observer [2024-12-09 14:47:31.273] [DEBUG] -- root@192.168.124.49 export LD_LIBRARY_PATH='/root/myoceanbase/oceanbase/lib:' [2024-12-09 14:47:31.274] [DEBUG] -- root@192.168.124.49 execute: cd /root/myoceanbase/oceanbase; /root/myoceanbase/oceanbase/bin/observer -r '192.168.124.46:2882:2881;192.168.124.49:2882:2881;192.168.124.52:2882:2881' -p 2881 -P 2882 -z 'zone2' -n 'myoceanbase' -c 1733726289 -d '/data/myoceanbase/oceanbase/store' -I '192.168.124.49' -o __min_full_resource_pool_memory=2147483648,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit='10G',datafile_size='25G',system_memory='3G',log_disk_size='25G',cpu_count=16,datafile_maxsize='63G',datafile_next='6G',large_query_threshold='600s',enable_record_trace_log=False,enable_syslog_recycle=1 [2024-12-09 14:47:31.589] [DEBUG] -- exited code 0 [2024-12-09 14:47:31.590] [DEBUG] -- root@192.168.124.49 export LD_LIBRARY_PATH='' [2024-12-09 14:47:31.590] [DEBUG] -- starting 192.168.124.52 observer [2024-12-09 14:47:31.590] [DEBUG] -- root@192.168.124.52 export LD_LIBRARY_PATH='/root/myoceanbase/oceanbase/lib:' [2024-12-09 14:47:31.590] [DEBUG] -- root@192.168.124.52 execute: cd /root/myoceanbase/oceanbase; /root/myoceanbase/oceanbase/bin/observer -r '192.168.124.46:2882:2881;192.168.124.49:2882:2881;192.168.124.52:2882:2881' -p 2881 -P 2882 -z 'zone3' -n 'myoceanbase' -c 1733726289 -d '/data/myoceanbase/oceanbase/store' -I '192.168.124.52' -o __min_full_resource_pool_memory=2147483648,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit='10G',datafile_size='25G',system_memory='3G',log_disk_size='25G',cpu_count=16,datafile_maxsize='63G',datafile_next='6G',large_query_threshold='600s',enable_record_trace_log=False,enable_syslog_recycle=1 [2024-12-09 14:47:31.894] [DEBUG] -- exited code 0 [2024-12-09 14:47:31.895] [DEBUG] -- root@192.168.124.52 export LD_LIBRARY_PATH='' [2024-12-09 14:47:31.895] [DEBUG] -- start_obshell: False [2024-12-09 14:47:31.896] [INFO] observer program health check [2024-12-09 14:47:34.899] [DEBUG] -- 192.168.124.46 program health check [2024-12-09 14:47:34.899] [DEBUG] -- root@192.168.124.46 execute: cat /root/myoceanbase/oceanbase/run/observer.pid [2024-12-09 14:47:34.977] [DEBUG] -- exited code 0 [2024-12-09 14:47:34.977] [DEBUG] -- root@192.168.124.46 execute: ls /proc/23389 [2024-12-09 14:47:35.128] [DEBUG] -- exited code 0 [2024-12-09 14:47:35.128] [DEBUG] -- 192.168.124.46 observer[pid: 23389] started [2024-12-09 14:47:35.129] [DEBUG] -- 192.168.124.49 program health check [2024-12-09 14:47:35.129] [DEBUG] -- root@192.168.124.49 execute: cat /root/myoceanbase/oceanbase/run/observer.pid [2024-12-09 14:47:35.244] [DEBUG] -- exited code 0 [2024-12-09 14:47:35.245] [DEBUG] -- root@192.168.124.49 execute: ls /proc/20873 [2024-12-09 14:47:35.368] [DEBUG] -- exited code 0 [2024-12-09 14:47:35.368] [DEBUG] -- 192.168.124.49 observer[pid: 20873] started [2024-12-09 14:47:35.369] [DEBUG] -- 192.168.124.52 program health check [2024-12-09 14:47:35.369] [DEBUG] -- root@192.168.124.52 execute: cat /root/myoceanbase/oceanbase/run/observer.pid [2024-12-09 14:47:35.457] [DEBUG] -- exited code 0 [2024-12-09 14:47:35.457] [DEBUG] -- root@192.168.124.52 execute: ls /proc/21266 [2024-12-09 14:47:35.568] [DEBUG] -- exited code 0 [2024-12-09 14:47:35.569] [DEBUG] -- 192.168.124.52 observer[pid: 21266] started [2024-12-09 14:47:35.569] [DEBUG] -- need_bootstrap: True [2024-12-09 14:47:35.569] [DEBUG] - sub start ref count to 0 [2024-12-09 14:47:35.569] [DEBUG] - export start [2024-12-09 14:47:35.570] [DEBUG] - plugin oceanbase-ce-py_script_start-4.3.0.0 result: True [2024-12-09 14:47:35.570] [DEBUG] - Call oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:47:35.570] [DEBUG] - import connect [2024-12-09 14:47:35.607] [DEBUG] - add connect ref count to 1 [2024-12-09 14:47:35.607] [DEBUG] -- connect obshell (192.168.124.46:2886) [2024-12-09 14:47:35.608] [DEBUG] -- connect obshell (192.168.124.49:2886) [2024-12-09 14:47:35.608] [DEBUG] -- connect obshell (192.168.124.52:2886) [2024-12-09 14:47:35.608] [INFO] Connect to observer [2024-12-09 14:47:35.609] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:47:35.613] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:47:35.618] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:47:38.625] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:47:38.628] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:47:38.631] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:47:41.637] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:47:41.639] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:47:41.690] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:47:44.695] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:47:44.703] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:47:44.706] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:47:47.716] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:47:47.718] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:47:47.720] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:47:50.725] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:47:50.728] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:47:50.729] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:47:53.736] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:47:53.744] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:47:53.746] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:47:56.752] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:47:56.754] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:47:56.756] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:47:59.762] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:47:59.765] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:47:59.767] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:48:02.773] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:48:02.775] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:48:02.777] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:48:05.783] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:48:05.785] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:48:05.788] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:48:08.793] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:48:08.798] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:48:08.801] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:48:11.807] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:48:11.810] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:48:11.813] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:48:14.819] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:48:14.822] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:48:14.824] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:48:17.829] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:48:17.831] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:48:17.834] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:48:20.838] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:48:20.840] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:48:20.843] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:48:23.848] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:48:23.856] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:48:23.872] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:48:26.878] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:48:26.881] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:48:26.884] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:48:29.890] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:48:29.905] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:48:29.911] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:48:32.933] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:48:32.938] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:48:32.941] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:48:35.953] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:48:35.956] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:48:35.958] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:48:38.963] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:48:38.965] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:48:38.967] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:48:41.972] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:48:41.974] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:48:41.976] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:48:44.982] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:48:44.984] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:48:44.986] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:48:47.991] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:48:47.994] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:48:47.996] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:48:51.002] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:48:51.006] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:48:51.010] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:48:54.018] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:48:54.020] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:48:54.022] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:48:57.027] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:48:57.030] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:48:57.032] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:49:00.037] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:49:00.039] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:49:00.041] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:49:03.048] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:49:03.063] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:49:03.071] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:49:06.089] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:49:06.095] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:49:06.104] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:49:09.113] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:49:09.135] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p [2024-12-09 14:49:09.144] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p [2024-12-09 14:49:12.158] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p****** [2024-12-09 14:49:12.240] [DEBUG] -- connect 192.168.124.49 -P2881 -uroot -p****** [2024-12-09 14:49:12.896] [DEBUG] -- connect 192.168.124.52 -P2881 -uroot -p****** [2024-12-09 14:49:15.996] [DEBUG] -- connect 192.168.124.46 -P2881 -uroot -p [2024-12-09 14:49:16.772] [DEBUG] -- execute sql: select 1. args: None [2024-12-09 14:49:16.778] [DEBUG] - sub connect ref count to 0 [2024-12-09 14:49:16.778] [DEBUG] - export connect [2024-12-09 14:49:16.778] [DEBUG] - plugin oceanbase-ce-py_script_connect-4.2.2.0 result: True [2024-12-09 14:49:16.779] [INFO] Initialize oceanbase-ce [2024-12-09 14:49:16.779] [DEBUG] - Call oceanbase-ce-py_script_bootstrap-4.2.2.0 for oceanbase-ce-4.3.4.0-100000162024110717.el7-5d59e837a0ecff1a6baa20f72747c343ac7c8dce [2024-12-09 14:49:16.779] [DEBUG] - import bootstrap [2024-12-09 14:49:16.794] [DEBUG] - add bootstrap ref count to 1 [2024-12-09 14:49:16.794] [DEBUG] -- bootstrap for components: dict_keys(['oceanbase-ce', 'obproxy-ce']) [2024-12-09 14:49:16.795] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2024-12-09 14:49:16.795] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000. args: None [2024-12-09 14:49:16.806] [DEBUG] -- execute sql: alter system bootstrap REGION "sys_region" ZONE "zone1" SERVER "192.168.124.46:2882",REGION "sys_region" ZONE "zone2" SERVER "192.168.124.49:2882",REGION "sys_region" ZONE "zone3" SERVER "192.168.124.52:2882". args: None [2024-12-09 14:55:14.198] [DEBUG] -- execute sql: alter user "root" IDENTIFIED BY %s. args: ['******'] [2024-12-09 14:55:15.710] [DEBUG] -- execute sql: select * from oceanbase.__all_server. args: None [2024-12-09 14:55:15.713] [DEBUG] -- root@192.168.124.46 execute: ls /root/myoceanbase/oceanbase/.meta [2024-12-09 14:55:15.838] [DEBUG] -- exited code 2, error output: [2024-12-09 14:55:15.838] [DEBUG] ls: cannot access '/root/myoceanbase/oceanbase/.meta': No such file or directory [2024-12-09 14:55:15.838] [DEBUG] [2024-12-09 14:55:15.839] [DEBUG] -- [2024-12-09 14:55:15.839] [DEBUG] -- ls: cannot access '/root/myoceanbase/oceanbase/.meta': No such file or directory [2024-12-09 14:55:15.839] [DEBUG] [2024-12-09 14:55:15.839] [DEBUG] -- root@192.168.124.46 execute: cat /root/myoceanbase/oceanbase/run/obshell.pid [2024-12-09 14:55:16.000] [DEBUG] -- exited code 1, error output: [2024-12-09 14:55:16.000] [DEBUG] cat: /root/myoceanbase/oceanbase/run/obshell.pid: No such file or directory [2024-12-09 14:55:16.000] [DEBUG] [2024-12-09 14:55:16.000] [DEBUG] -- root@192.168.124.46 execute: strings /root/myoceanbase/oceanbase/etc/observer.conf.bin [2024-12-09 14:55:16.478] [DEBUG] -- exited code 1, error output: [2024-12-09 14:55:16.478] [DEBUG] strings: '/root/myoceanbase/oceanbase/etc/observer.conf.bin': No such file [2024-12-09 14:55:16.478] [DEBUG] [2024-12-09 14:55:16.478] [DEBUG] -- [2024-12-09 14:55:16.479] [DEBUG] -- strings: '/root/myoceanbase/oceanbase/etc/observer.conf.bin': No such file [2024-12-09 14:55:16.479] [DEBUG] [2024-12-09 14:55:16.480] [DEBUG] -- root@192.168.124.49 execute: ls /root/myoceanbase/oceanbase/.meta [2024-12-09 14:55:16.616] [DEBUG] -- exited code 2, error output: [2024-12-09 14:55:16.617] [DEBUG] ls: cannot access '/root/myoceanbase/oceanbase/.meta': No such file or directory [2024-12-09 14:55:16.617] [DEBUG] [2024-12-09 14:55:16.617] [DEBUG] -- [2024-12-09 14:55:16.617] [DEBUG] -- ls: cannot access '/root/myoceanbase/oceanbase/.meta': No such file or directory [2024-12-09 14:55:16.617] [DEBUG] [2024-12-09 14:55:16.617] [DEBUG] -- root@192.168.124.49 execute: cat /root/myoceanbase/oceanbase/run/obshell.pid [2024-12-09 14:55:16.793] [DEBUG] -- exited code 1, error output: [2024-12-09 14:55:16.794] [DEBUG] cat: /root/myoceanbase/oceanbase/run/obshell.pid: No such file or directory [2024-12-09 14:55:16.794] [DEBUG] [2024-12-09 14:55:16.794] [DEBUG] -- root@192.168.124.49 execute: strings /root/myoceanbase/oceanbase/etc/observer.conf.bin [2024-12-09 14:55:17.310] [DEBUG] -- exited code 1, error output: [2024-12-09 14:55:17.310] [DEBUG] strings: '/root/myoceanbase/oceanbase/etc/observer.conf.bin': No such file [2024-12-09 14:55:17.311] [DEBUG] [2024-12-09 14:55:17.314] [DEBUG] -- [2024-12-09 14:55:17.314] [DEBUG] -- strings: '/root/myoceanbase/oceanbase/etc/observer.conf.bin': No such file [2024-12-09 14:55:17.314] [DEBUG] [2024-12-09 14:55:17.314] [DEBUG] -- root@192.168.124.52 execute: ls /root/myoceanbase/oceanbase/.meta [2024-12-09 14:55:17.442] [DEBUG] -- exited code 2, error output: [2024-12-09 14:55:17.442] [DEBUG] ls: cannot access '/root/myoceanbase/oceanbase/.meta': No such file or directory [2024-12-09 14:55:17.442] [DEBUG] [2024-12-09 14:55:17.444] [DEBUG] -- [2024-12-09 14:55:17.444] [DEBUG] -- ls: cannot access '/root/myoceanbase/oceanbase/.meta': No such file or directory [2024-12-09 14:55:17.444] [DEBUG] [2024-12-09 14:55:17.444] [DEBUG] -- root@192.168.124.52 execute: cat /root/myoceanbase/oceanbase/run/obshell.pid [2024-12-09 14:55:17.602] [DEBUG] -- exited code 1, error output: [2024-12-09 14:55:17.603] [DEBUG] cat: /root/myoceanbase/oceanbase/run/obshell.pid: No such file or directory [2024-12-09 14:55:17.603] [DEBUG] [2024-12-09 14:55:17.603] [DEBUG] -- root@192.168.124.52 execute: strings /root/myoceanbase/oceanbase/etc/observer.conf.bin [2024-12-09 14:55:18.208] [DEBUG] -- exited code 1, error output: [2024-12-09 14:55:18.208] [DEBUG] strings: '/root/myoceanbase/oceanbase/etc/observer.conf.bin': No such file [2024-12-09 14:55:18.208] [DEBUG] [2024-12-09 14:55:18.208] [DEBUG] -- [2024-12-09 14:55:18.208] [DEBUG] -- strings: '/root/myoceanbase/oceanbase/etc/observer.conf.bin': No such file [2024-12-09 14:55:18.208] [DEBUG] [2024-12-09 14:55:18.208] [DEBUG] -- root@192.168.124.46 execute: cat /root/myoceanbase/oceanbase/run/obshell.pid [2024-12-09 14:55:18.295] [DEBUG] -- exited code 1, error output: [2024-12-09 14:55:18.296] [DEBUG] cat: /root/myoceanbase/oceanbase/run/obshell.pid: No such file or directory [2024-12-09 14:55:18.296] [DEBUG] [2024-12-09 14:55:18.296] [DEBUG] -- root@192.168.124.46 export OB_ROOT_PASSWORD=''******'' [2024-12-09 14:55:18.296] [DEBUG] -- start obshell: cd /root/myoceanbase/oceanbase; /root/myoceanbase/oceanbase/bin/obshell admin start --ip 192.168.124.46 --port 2886 [2024-12-09 14:55:18.297] [DEBUG] -- root@192.168.124.46 execute: cd /root/myoceanbase/oceanbase; /root/myoceanbase/oceanbase/bin/obshell admin start --ip 192.168.124.46 --port 2886 [2024-12-09 14:58:01.242] [DEBUG] -- exited code 0 [2024-12-09 14:58:01.242] [DEBUG] -- root@192.168.124.49 execute: cat /root/myoceanbase/oceanbase/run/obshell.pid [2024-12-09 14:58:01.382] [DEBUG] -- exited code 1, error output: [2024-12-09 14:58:01.382] [DEBUG] cat: /root/myoceanbase/oceanbase/run/obshell.pid: No such file or directory [2024-12-09 14:58:01.382] [DEBUG] [2024-12-09 14:58:01.382] [DEBUG] -- root@192.168.124.49 export OB_ROOT_PASSWORD=''******'' [2024-12-09 14:58:01.384] [DEBUG] -- start obshell: cd /root/myoceanbase/oceanbase; /root/myoceanbase/oceanbase/bin/obshell admin start --ip 192.168.124.49 --port 2886 [2024-12-09 14:58:01.384] [DEBUG] -- root@192.168.124.49 execute: cd /root/myoceanbase/oceanbase; /root/myoceanbase/oceanbase/bin/obshell admin start --ip 192.168.124.49 --port 2886 [2024-12-09 14:59:07.444] [DEBUG] -- exited code 0 [2024-12-09 14:59:07.445] [DEBUG] -- root@192.168.124.52 execute: cat /root/myoceanbase/oceanbase/run/obshell.pid [2024-12-09 14:59:07.533] [DEBUG] -- exited code 1, error output: [2024-12-09 14:59:07.534] [DEBUG] cat: /root/myoceanbase/oceanbase/run/obshell.pid: No such file or directory [2024-12-09 14:59:07.534] [DEBUG] [2024-12-09 14:59:07.534] [DEBUG] -- root@192.168.124.52 export OB_ROOT_PASSWORD=''******'' [2024-12-09 14:59:07.535] [DEBUG] -- start obshell: cd /root/myoceanbase/oceanbase; /root/myoceanbase/oceanbase/bin/obshell admin start --ip 192.168.124.52 --port 2886 [2024-12-09 14:59:07.535] [DEBUG] -- root@192.168.124.52 execute: cd /root/myoceanbase/oceanbase; /root/myoceanbase/oceanbase/bin/obshell admin start --ip 192.168.124.52 --port 2886 [2024-12-09 15:00:13.966] [DEBUG] -- exited code 0 [2024-12-09 15:00:16.970] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/status, data: {}, headers: None, params: None [2024-12-09 15:00:16.980] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/status, data: {}, headers: None, params: None [2024-12-09 15:00:16.996] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/status, data: {}, headers: None, params: None [2024-12-09 15:00:18.419] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/maintain/agent, data: gu/+l91REzWf94Ltb7PlEQ==, headers: None, params: None [2024-12-09 15:00:18.420] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:18.431] [DEBUG] -- request obshell failed: [2024-12-09 15:00:18.449] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/maintain/agent, data: dzZvc6oZISvbJT9FEs/ddg==, headers: None, params: None [2024-12-09 15:00:18.450] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:18.465] [DEBUG] -- request obshell failed: [2024-12-09 15:00:23.125] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/maintain/agent, data: AFXnrYzWGfQL6bn6husxsA==, headers: None, params: None [2024-12-09 15:00:23.125] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:23.137] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/23232267316028861, data: AFXnrYzWGfQL6bn6husxsA==, headers: None, params: None [2024-12-09 15:00:23.137] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:24.149] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/23232267316028861, data: AFXnrYzWGfQL6bn6husxsA==, headers: None, params: None [2024-12-09 15:00:24.149] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:28.411] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/23232267316028861, data: AFXnrYzWGfQL6bn6husxsA==, headers: None, params: None [2024-12-09 15:00:28.411] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:29.532] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/23232267316028861, data: AFXnrYzWGfQL6bn6husxsA==, headers: None, params: None [2024-12-09 15:00:29.532] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:30.545] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/23232267316028861, data: AFXnrYzWGfQL6bn6husxsA==, headers: None, params: None [2024-12-09 15:00:30.545] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:31.559] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/23232267316028861, data: AFXnrYzWGfQL6bn6husxsA==, headers: None, params: None [2024-12-09 15:00:31.559] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:33.376] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/23232267316028861, data: AFXnrYzWGfQL6bn6husxsA==, headers: None, params: None [2024-12-09 15:00:33.376] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:36.237] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/task/dag/23232267316028861, data: AFXnrYzWGfQL6bn6husxsA==, headers: None, params: None [2024-12-09 15:00:36.237] [DEBUG] -- send request to obshell: method: GET, url: /api/v1/secret, data: {}, headers: None, params: None [2024-12-09 15:00:41.263] [DEBUG] -- request obshell failed: [2024-12-09 15:00:41.264] [DEBUG] -- find take over dag failed, count: 600 [2024-12-09 15:00:42.266] [ERROR] obshell take over failed [2024-12-09 15:00:42.267] [DEBUG] - sub bootstrap ref count to 0 [2024-12-09 15:00:42.267] [DEBUG] - export bootstrap [2024-12-09 15:00:42.267] [DEBUG] - plugin oceanbase-ce-py_script_bootstrap-4.2.2.0 result: False [2024-12-09 15:00:42.267] [INFO] [ERROR] obshell take over failed [2024-12-09 15:00:42.267] [INFO] [2024-12-09 15:00:42.267] [ERROR] Cluster init failed ```