[2024-10-12 19:38:40.880] [DEBUG] - cmd: ['ob_single'] [2024-10-12 19:38:40.880] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2024-10-12 19:38:40.881] [DEBUG] - mkdir /home/admin/.obd/lock/ [2024-10-12 19:38:40.881] [DEBUG] - unknown lock mode [2024-10-12 19:38:40.881] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2024-10-12 19:38:40.881] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2024-10-12 19:38:40.881] [DEBUG] - Get Deploy by name [2024-10-12 19:38:40.881] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2024-10-12 19:38:40.882] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2024-10-12 19:38:40.882] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_ob_single [2024-10-12 19:38:40.882] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_ob_single`, count 1 [2024-10-12 19:38:40.905] [DEBUG] - Deploy status judge [2024-10-12 19:38:40.906] [INFO] Get local repositories [2024-10-12 19:38:40.918] [DEBUG] - mkdir /home/admin/.obd/repository [2024-10-12 19:38:40.919] [DEBUG] - Get local repository oceanbase-ce-4.2.1.1-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:40.919] [DEBUG] - Search repository oceanbase-ce version: 4.2.1.1, tag: ee47f7d89ad323bd634a5976f6e89f04911f81a4, release: None, package_hash: None [2024-10-12 19:38:40.919] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2024-10-12 19:38:40.919] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2024-10-12 19:38:40.919] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2024-10-12 19:38:40.922] [DEBUG] - Found repository oceanbase-ce-4.2.1.1-101000062023110109.el7-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:40.922] [DEBUG] - Get local repository obproxy-ce-4.2.1.0-0aed4b782120e4248b749f67be3d2cc82cdcb70d [2024-10-12 19:38:40.922] [DEBUG] - Search repository obproxy-ce version: 4.2.1.0, tag: 0aed4b782120e4248b749f67be3d2cc82cdcb70d, release: None, package_hash: None [2024-10-12 19:38:40.922] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2024-10-12 19:38:40.922] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2024-10-12 19:38:40.924] [DEBUG] - Found repository obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d [2024-10-12 19:38:41.049] [DEBUG] - Get deploy config [2024-10-12 19:38:41.084] [INFO] Search plugins [2024-10-12 19:38:41.096] [DEBUG] - Searching start_check plugin for components ... [2024-10-12 19:38:41.096] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.2.1.1-101000062023110109.el7-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:41.097] [DEBUG] - mkdir /home/admin/.obd/plugins [2024-10-12 19:38:41.098] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.2.0.0 for oceanbase-ce-4.2.1.1 [2024-10-12 19:38:41.098] [DEBUG] - Searching start_check plugin for obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d [2024-10-12 19:38:41.098] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.2.1.0 [2024-10-12 19:38:41.098] [DEBUG] - Searching create_tenant plugin for components ... [2024-10-12 19:38:41.098] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.2.1.1-101000062023110109.el7-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:41.099] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.2.0.0 for oceanbase-ce-4.2.1.1 [2024-10-12 19:38:41.099] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d [2024-10-12 19:38:41.099] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.2.1.0 [2024-10-12 19:38:41.099] [DEBUG] - Searching start plugin for components ... [2024-10-12 19:38:41.099] [DEBUG] - Searching start plugin for oceanbase-ce-4.2.1.1-101000062023110109.el7-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:41.099] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.2.1.1 [2024-10-12 19:38:41.099] [DEBUG] - Searching start plugin for obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d [2024-10-12 19:38:41.100] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.2.1.0 [2024-10-12 19:38:41.100] [DEBUG] - Searching connect plugin for components ... [2024-10-12 19:38:41.100] [DEBUG] - Searching connect plugin for oceanbase-ce-4.2.1.1-101000062023110109.el7-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:41.100] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.2.1.1 [2024-10-12 19:38:41.100] [DEBUG] - Searching connect plugin for obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d [2024-10-12 19:38:41.100] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.1.0 [2024-10-12 19:38:41.100] [DEBUG] - Searching bootstrap plugin for components ... [2024-10-12 19:38:41.101] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.2.1.1-101000062023110109.el7-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:41.101] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.2.1.1 [2024-10-12 19:38:41.101] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d [2024-10-12 19:38:41.101] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.2.1.0 [2024-10-12 19:38:41.101] [DEBUG] - Searching display plugin for components ... [2024-10-12 19:38:41.101] [DEBUG] - Searching display plugin for oceanbase-ce-4.2.1.1-101000062023110109.el7-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:41.102] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.1.1 [2024-10-12 19:38:41.102] [DEBUG] - Searching display plugin for obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d [2024-10-12 19:38:41.102] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.1.0 [2024-10-12 19:38:41.227] [INFO] Open ssh connection [2024-10-12 19:38:41.363] [INFO] Load cluster param plugin [2024-10-12 19:38:41.370] [DEBUG] - Searching param plugin for components ... [2024-10-12 19:38:41.370] [DEBUG] - Search param plugin for oceanbase-ce [2024-10-12 19:38:41.370] [DEBUG] - Found for oceanbase-ce-param-4.2.0.0 for oceanbase-ce-4.2.1.1 [2024-10-12 19:38:41.370] [DEBUG] - Applying oceanbase-ce-param-4.2.0.0 for oceanbase-ce-4.2.1.1-101000062023110109.el7-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:43.277] [DEBUG] - Search param plugin for obproxy-ce [2024-10-12 19:38:43.278] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.2.1.0 [2024-10-12 19:38:43.278] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d [2024-10-12 19:38:43.774] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.2.0.0 for oceanbase-ce-4.2.1.1-101000062023110109.el7-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:43.774] [DEBUG] - import start_check [2024-10-12 19:38:43.782] [DEBUG] - add start_check ref count to 1 [2024-10-12 19:38:43.782] [INFO] Check before start observer [2024-10-12 19:38:43.784] [DEBUG] -- local execute: ls /mnt/software/oceanbase/home/observer/store/clog/tenant_1/ [2024-10-12 19:38:43.799] [DEBUG] -- exited code 0 [2024-10-12 19:38:43.800] [DEBUG] -- local execute: cat /mnt/software/oceanbase/home/observer/run/observer.pid [2024-10-12 19:38:43.808] [DEBUG] -- exited code 0 [2024-10-12 19:38:43.808] [DEBUG] -- local execute: ls /proc/3997398 [2024-10-12 19:38:43.822] [DEBUG] -- exited code 2, error output: [2024-10-12 19:38:43.823] [DEBUG] ls: cannot access '/proc/3997398': No such file or directory [2024-10-12 19:38:43.823] [DEBUG] [2024-10-12 19:38:43.823] [DEBUG] -- 127.0.0.1 port check [2024-10-12 19:38:43.823] [DEBUG] -- local execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2024-10-12 19:38:43.865] [DEBUG] -- exited code 137, error output: [2024-10-12 19:38:43.865] [DEBUG] /bin/sh: line 1: 902590 Killed bash -c 'cat /proc/net/{tcp*,udp*}' [2024-10-12 19:38:43.865] [DEBUG] 902591 | awk -F' ' '{print $2,$10}' [2024-10-12 19:38:43.865] [DEBUG] 902592 | grep '00000000:0B41' [2024-10-12 19:38:43.865] [DEBUG] 902593 | awk -F' ' '{print $2}' [2024-10-12 19:38:43.865] [DEBUG] 902594 | uniq [2024-10-12 19:38:43.865] [DEBUG] [2024-10-12 19:38:43.866] [DEBUG] -- local execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2024-10-12 19:38:43.909] [DEBUG] -- exited code 137, error output: [2024-10-12 19:38:43.909] [DEBUG] /bin/sh: line 1: 902596 Killed bash -c 'cat /proc/net/{tcp*,udp*}' [2024-10-12 19:38:43.909] [DEBUG] 902597 | awk -F' ' '{print $2,$10}' [2024-10-12 19:38:43.909] [DEBUG] 902598 | grep '00000000:0B42' [2024-10-12 19:38:43.909] [DEBUG] 902599 Done | awk -F' ' '{print $2}' [2024-10-12 19:38:43.909] [DEBUG] 902600 | uniq [2024-10-12 19:38:43.909] [DEBUG] [2024-10-12 19:38:43.910] [DEBUG] -- local execute: ls /mnt/software/oceanbase/home/observer/store/sstable/block_file [2024-10-12 19:38:43.929] [DEBUG] -- exited code 0 [2024-10-12 19:38:43.930] [DEBUG] -- local execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-10-12 19:38:43.943] [DEBUG] -- exited code 0 [2024-10-12 19:38:43.944] [WARNING] OBD-1011: (127.0.0.1) The recommended value of fs.aio-max-nr is 1048576 (Current value: 65536) [2024-10-12 19:38:43.944] [DEBUG] -- local execute: ulimit -a [2024-10-12 19:38:43.957] [DEBUG] -- exited code 0 [2024-10-12 19:38:43.958] [WARNING] OBD-1007: (127.0.0.1) The recommended number of open files is 655350 (Current value: 65535) [2024-10-12 19:38:43.958] [DEBUG] -- local execute: cat /proc/meminfo [2024-10-12 19:38:43.974] [DEBUG] -- exited code 0 [2024-10-12 19:38:43.975] [DEBUG] -- local execute: df --block-size=1024 [2024-10-12 19:38:43.992] [DEBUG] -- exited code 0 [2024-10-12 19:38:43.993] [DEBUG] -- get disk info for path /dev, total: 16842731520 avail: 16842731520 [2024-10-12 19:38:43.993] [DEBUG] -- get disk info for path /dev/shm, total: 16860942336 avail: 16860942336 [2024-10-12 19:38:43.993] [DEBUG] -- get disk info for path /run, total: 16860942336 avail: 16859484160 [2024-10-12 19:38:43.993] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 16860942336 avail: 16860942336 [2024-10-12 19:38:43.993] [DEBUG] -- get disk info for path /, total: 42140381184 avail: 10812817408 [2024-10-12 19:38:43.993] [DEBUG] -- get disk info for path /tmp, total: 16860942336 avail: 16753025024 [2024-10-12 19:38:43.993] [DEBUG] -- get disk info for path /mnt, total: 210303426560 avail: 68614303744 [2024-10-12 19:38:43.993] [DEBUG] -- get disk info for path /run/user/0, total: 3372187648 avail: 3372187648 [2024-10-12 19:38:43.993] [DEBUG] -- disk: {'/dev': {'total': 16842731520, 'avail': 16842731520, 'need': 0}, '/dev/shm': {'total': 16860942336, 'avail': 16860942336, 'need': 0}, '/run': {'total': 16860942336, 'avail': 16859484160, 'need': 0}, '/sys/fs/cgroup': {'total': 16860942336, 'avail': 16860942336, 'need': 0}, '/': {'total': 42140381184, 'avail': 10812817408, 'need': 0}, '/tmp': {'total': 16860942336, 'avail': 16753025024, 'need': 0}, '/mnt': {'total': 210303426560, 'avail': 68614303744, 'need': 0}, '/run/user/0': {'total': 3372187648, 'avail': 3372187648, 'need': 0}} [2024-10-12 19:38:43.994] [DEBUG] -- local execute: date +%s%N [2024-10-12 19:38:44.002] [DEBUG] -- exited code 0 [2024-10-12 19:38:44.002] [DEBUG] -- 127.0.0.1 time delta -3.464111328125 [2024-10-12 19:38:44.044] [INFO] [WARN] OBD-1011: (127.0.0.1) The recommended value of fs.aio-max-nr is 1048576 (Current value: 65536) [2024-10-12 19:38:44.044] [INFO] [WARN] OBD-1007: (127.0.0.1) The recommended number of open files is 655350 (Current value: 65535) [2024-10-12 19:38:44.044] [INFO] [2024-10-12 19:38:44.044] [DEBUG] - sub start_check ref count to 0 [2024-10-12 19:38:44.044] [DEBUG] - export start_check [2024-10-12 19:38:44.045] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d [2024-10-12 19:38:44.045] [DEBUG] - import start_check [2024-10-12 19:38:44.047] [DEBUG] - add start_check ref count to 1 [2024-10-12 19:38:44.047] [INFO] Check before start obproxy [2024-10-12 19:38:44.053] [DEBUG] -- local execute: cat /mnt/software/oceanbase/home/obproxy/run/obproxy-127.0.0.1-2883.pid [2024-10-12 19:38:44.069] [DEBUG] -- exited code 1, error output: [2024-10-12 19:38:44.069] [DEBUG] cat: /mnt/software/oceanbase/home/obproxy/run/obproxy-127.0.0.1-2883.pid: No such file or directory [2024-10-12 19:38:44.069] [DEBUG] [2024-10-12 19:38:44.070] [DEBUG] -- 127.0.0.1 port check [2024-10-12 19:38:44.070] [DEBUG] -- local execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-10-12 19:38:44.096] [DEBUG] -- exited code 137, error output: [2024-10-12 19:38:44.096] [DEBUG] /bin/sh: line 1: 902616 Killed bash -c 'cat /proc/net/{tcp*,udp*}' [2024-10-12 19:38:44.096] [DEBUG] 902617 | awk -F' ' '{print $2,$10}' [2024-10-12 19:38:44.096] [DEBUG] 902618 | grep '00000000:0B43' [2024-10-12 19:38:44.096] [DEBUG] 902619 | awk -F' ' '{print $2}' [2024-10-12 19:38:44.096] [DEBUG] 902620 | uniq [2024-10-12 19:38:44.096] [DEBUG] [2024-10-12 19:38:44.096] [DEBUG] -- local execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2024-10-12 19:38:44.142] [DEBUG] -- exited code 137, error output: [2024-10-12 19:38:44.142] [DEBUG] /bin/sh: line 1: 902622 Killed bash -c 'cat /proc/net/{tcp*,udp*}' [2024-10-12 19:38:44.142] [DEBUG] 902623 | awk -F' ' '{print $2,$10}' [2024-10-12 19:38:44.142] [DEBUG] 902624 | grep '00000000:0B44' [2024-10-12 19:38:44.142] [DEBUG] 902625 | awk -F' ' '{print $2}' [2024-10-12 19:38:44.142] [DEBUG] 902626 | uniq [2024-10-12 19:38:44.142] [DEBUG] [2024-10-12 19:38:44.188] [DEBUG] - sub start_check ref count to 0 [2024-10-12 19:38:44.188] [DEBUG] - export start_check [2024-10-12 19:38:44.188] [DEBUG] - Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.2.1.1-101000062023110109.el7-ee47f7d89ad323bd634a5976f6e89f04911f81a4 [2024-10-12 19:38:44.188] [DEBUG] - import start [2024-10-12 19:38:44.191] [DEBUG] - add start ref count to 1 [2024-10-12 19:38:44.191] [INFO] Start observer [2024-10-12 19:38:44.192] [DEBUG] -- local execute: ls /mnt/software/oceanbase/home/observer/store/clog/tenant_1/ [2024-10-12 19:38:44.207] [DEBUG] -- exited code 0 [2024-10-12 19:38:44.208] [DEBUG] -- local execute: cat /mnt/software/oceanbase/home/observer/run/observer.pid [2024-10-12 19:38:44.228] [DEBUG] -- exited code 0 [2024-10-12 19:38:44.228] [DEBUG] -- local execute: ls /proc/3997398 [2024-10-12 19:38:44.248] [DEBUG] -- exited code 2, error output: [2024-10-12 19:38:44.248] [DEBUG] ls: cannot access '/proc/3997398': No such file or directory [2024-10-12 19:38:44.248] [DEBUG] [2024-10-12 19:38:44.248] [DEBUG] -- 127.0.0.1 start command construction [2024-10-12 19:38:44.249] [DEBUG] -- starting 127.0.0.1 observer [2024-10-12 19:38:44.249] [DEBUG] -- admin@127.0.0.1 set env LD_LIBRARY_PATH to '/mnt/software/oceanbase/home/observer/lib:' [2024-10-12 19:38:44.249] [DEBUG] -- local execute: cd /mnt/software/oceanbase/home/observer; /mnt/software/oceanbase/home/observer/bin/observer -r '127.0.0.1:2882:2881' -p 2881 -P 2882 -z 'zone1' -n 'single' -c 1 -d '/mnt/software/oceanbase/home/observer/store' -i 'lo' -o __min_full_resource_pool_memory=2147483648,memory_limit='12G',system_memory='2G',datafile_size='2G',datafile_next='2G',datafile_maxsize='50G',log_disk_size='13G',cpu_count=10,enable_syslog_wf=False,enable_sy