-bash-4.2$ obd display-trace 59d161c4-48a8-11ee-b5d5-0050569c579a [2023-09-01 17:17:19.366] [DEBUG] - cmd: ['obce-3n'] [2023-09-01 17:17:19.366] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2023-09-01 17:17:19.367] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-09-01 17:17:19.367] [DEBUG] - unknown lock mode [2023-09-01 17:17:19.367] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-09-01 17:17:19.367] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-09-01 17:17:19.367] [DEBUG] - Get Deploy by name [2023-09-01 17:17:19.367] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-09-01 17:17:19.367] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-09-01 17:17:19.368] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_obce-3n [2023-09-01 17:17:19.368] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_obce-3n`, count 1 [2023-09-01 17:17:19.372] [DEBUG] - Deploy status judge [2023-09-01 17:17:19.372] [INFO] Get local repositories [2023-09-01 17:17:19.373] [DEBUG] - mkdir /home/admin/.obd/repository [2023-09-01 17:17:19.373] [DEBUG] - Get local repository oceanbase-ce-3.1.5-1ac7ca847d4d1461ecd4da1848 4a823cc0508795 [2023-09-01 17:17:19.373] [DEBUG] - Search repository oceanbase-ce version: 3.1.5, tag: 1ac7ca847d4d14 61ecd4da18484a823cc0508795, release: None, package_hash: None [2023-09-01 17:17:19.373] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-09-01 17:17:19.373] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-09-01 17:17:19.373] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2023-09-01 17:17:19.375] [DEBUG] - Found repository oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca8 47d4d1461ecd4da18484a823cc0508795 [2023-09-01 17:17:19.375] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458 d85e31d2f6c3 [2023-09-01 17:17:19.375] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: de53232a951184fa d75b15884458d85e31d2f6c3, release: None, package_hash: None [2023-09-01 17:17:19.375] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-09-01 17:17:19.375] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2023-09-01 17:17:19.377] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b158844 58d85e31d2f6c3 [2023-09-01 17:17:19.504] [DEBUG] - Get deploy config [2023-09-01 17:17:19.531] [INFO] Search plugins [2023-09-01 17:17:19.532] [DEBUG] - Searching start_check plugin for components ... [2023-09-01 17:17:19.533] [DEBUG] - Searching start_check plugin for oceanbase-ce-3.1.5-10001001202306 0910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795 [2023-09-01 17:17:19.533] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-09-01 17:17:19.534] [DEBUG] - Found for oceanbase-ce-py_script_start_check-3.1.0 for oceanbase-c e-3.1.5 [2023-09-01 17:17:19.534] [DEBUG] - Searching start_check plugin for obproxy-ce-4.0.0-5.el7-de53232a95 1184fad75b15884458d85e31d2f6c3 [2023-09-01 17:17:19.534] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4. 0.0 [2023-09-01 17:17:19.534] [DEBUG] - Searching create_tenant plugin for components ... [2023-09-01 17:17:19.534] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-3.1.5-100010012023 060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795 [2023-09-01 17:17:19.535] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-3.1.0 for oceanbase -ce-3.1.5 [2023-09-01 17:17:19.535] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.0.0-5.el7-de53232a 951184fad75b15884458d85e31d2f6c3 [2023-09-01 17:17:19.535] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.0.0 [2023-09-01 17:17:19.535] [DEBUG] - Searching start plugin for components ... [2023-09-01 17:17:19.535] [DEBUG] - Searching start plugin for oceanbase-ce-3.1.5-100010012023060910.e l7-1ac7ca847d4d1461ecd4da18484a823cc0508795 [2023-09-01 17:17:19.535] [DEBUG] - Found for oceanbase-ce-py_script_start-3.1.0 for oceanbase-ce-3.1. 5 [2023-09-01 17:17:19.535] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fa d75b15884458d85e31d2f6c3 [2023-09-01 17:17:19.535] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-09-01 17:17:19.535] [DEBUG] - Searching connect plugin for components ... [2023-09-01 17:17:19.535] [DEBUG] - Searching connect plugin for oceanbase-ce-3.1.5-100010012023060910 .el7-1ac7ca847d4d1461ecd4da18484a823cc0508795 [2023-09-01 17:17:19.536] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-3. 1.5 [2023-09-01 17:17:19.536] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184 fad75b15884458d85e31d2f6c3 [2023-09-01 17:17:19.536] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-09-01 17:17:19.536] [DEBUG] - Searching bootstrap plugin for components ... [2023-09-01 17:17:19.536] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-3.1.5-1000100120230609 10.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795 [2023-09-01 17:17:19.536] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-3.1.0 for oceanbase-ce- 3.1.5 [2023-09-01 17:17:19.536] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a9511 84fad75b15884458d85e31d2f6c3 [2023-09-01 17:17:19.537] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0. 0 [2023-09-01 17:17:19.537] [DEBUG] - Searching display plugin for components ... [2023-09-01 17:17:19.537] [DEBUG] - Searching display plugin for oceanbase-ce-3.1.5-100010012023060910 .el7-1ac7ca847d4d1461ecd4da18484a823cc0508795 [2023-09-01 17:17:19.537] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-3. 1.5 [2023-09-01 17:17:19.537] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184 fad75b15884458d85e31d2f6c3 [2023-09-01 17:17:19.537] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-09-01 17:17:19.664] [INFO] Open ssh connection [2023-09-01 17:17:20.195] [INFO] Load cluster param plugin [2023-09-01 17:17:20.196] [DEBUG] - Searching param plugin for components ... [2023-09-01 17:17:20.197] [DEBUG] - Search param plugin for oceanbase-ce [2023-09-01 17:17:20.199] [DEBUG] - Found for oceanbase-ce-param-3.1.0 for oceanbase-ce-3.1.5 [2023-09-01 17:17:20.199] [DEBUG] - Applying oceanbase-ce-param-3.1.0 for oceanbase-ce-3.1.5-100010012 023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795 [2023-09-01 17:17:20.766] [DEBUG] - Search param plugin for obproxy-ce [2023-09-01 17:17:20.767] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-09-01 17:17:20.767] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232 a951184fad75b15884458d85e31d2f6c3 [2023-09-01 17:17:20.938] [DEBUG] - Call oceanbase-ce-py_script_start_check-3.1.0 for oceanbase-ce-3.1 .5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795 [2023-09-01 17:17:20.938] [DEBUG] - import start_check [2023-09-01 17:17:20.947] [DEBUG] - add start_check ref count to 1 [2023-09-01 17:17:20.948] [INFO] Check before start observer [2023-09-01 17:17:20.949] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer1/oc eanbase/run/observer.pid [2023-09-01 17:17:20.963] [DEBUG] -- exited code 1, error output: [2023-09-01 17:17:20.963] [DEBUG] cat: /home/soar/oceanbase/observer1/oceanbase/run/observer.pid: No s uch file or directory [2023-09-01 17:17:20.963] [DEBUG] [2023-09-01 17:17:20.964] [DEBUG] -- server1(96.0.221.160) port check [2023-09-01 17:17:20.964] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-09-01 17:17:21.019] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.020] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-09-01 17:17:21.076] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.077] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer1/dat a/sstable/block_file [2023-09-01 17:17:21.129] [DEBUG] -- exited code 2, error output: [2023-09-01 17:17:21.129] [DEBUG] ls: cannot access /home/soar/oceanbase/observer1/data/sstable/block_ file: No such file or directory [2023-09-01 17:17:21.129] [DEBUG] [2023-09-01 17:17:21.130] [DEBUG] -- admin@96.0.221.160 execute: grep -e '^ *ens192:' /proc/net/dev [2023-09-01 17:17:21.177] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.179] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer2/oc eanbase/run/observer.pid [2023-09-01 17:17:21.189] [DEBUG] -- exited code 1, error output: [2023-09-01 17:17:21.189] [DEBUG] cat: /home/soar/oceanbase/observer2/oceanbase/run/observer.pid: No s uch file or directory [2023-09-01 17:17:21.190] [DEBUG] [2023-09-01 17:17:21.190] [DEBUG] -- server2(96.0.221.160) port check [2023-09-01 17:17:21.190] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0F29' | awk -F' ' '{print $2}' | uniq [2023-09-01 17:17:21.246] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.247] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0F2A' | awk -F' ' '{print $2}' | uniq [2023-09-01 17:17:21.302] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.302] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer2/dat a/sstable/block_file [2023-09-01 17:17:21.351] [DEBUG] -- exited code 2, error output: [2023-09-01 17:17:21.351] [DEBUG] ls: cannot access /home/soar/oceanbase/observer2/data/sstable/block_ file: No such file or directory [2023-09-01 17:17:21.351] [DEBUG] [2023-09-01 17:17:21.351] [DEBUG] -- admin@96.0.221.160 execute: grep -e '^ *ens192:' /proc/net/dev [2023-09-01 17:17:21.401] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.401] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer3/oc eanbase/run/observer.pid [2023-09-01 17:17:21.409] [DEBUG] -- exited code 1, error output: [2023-09-01 17:17:21.410] [DEBUG] cat: /home/soar/oceanbase/observer3/oceanbase/run/observer.pid: No s uch file or directory [2023-09-01 17:17:21.410] [DEBUG] [2023-09-01 17:17:21.410] [DEBUG] -- server3(96.0.221.160) port check [2023-09-01 17:17:21.410] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1311' | awk -F' ' '{print $2}' | uniq [2023-09-01 17:17:21.464] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.465] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1312' | awk -F' ' '{print $2}' | uniq [2023-09-01 17:17:21.519] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.519] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer3/dat a/sstable/block_file [2023-09-01 17:17:21.570] [DEBUG] -- exited code 2, error output: [2023-09-01 17:17:21.570] [DEBUG] ls: cannot access /home/soar/oceanbase/observer3/data/sstable/block_ file: No such file or directory [2023-09-01 17:17:21.570] [DEBUG] [2023-09-01 17:17:21.570] [DEBUG] -- admin@96.0.221.160 execute: grep -e '^ *ens192:' /proc/net/dev [2023-09-01 17:17:21.618] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.618] [DEBUG] -- admin@96.0.221.160 execute: cat /proc/sys/fs/aio-max-nr /proc/sys /fs/aio-nr [2023-09-01 17:17:21.671] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.672] [DEBUG] -- admin@96.0.221.160 execute: ulimit -a [2023-09-01 17:17:21.717] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.718] [DEBUG] -- admin@96.0.221.160 execute: cat /proc/meminfo [2023-09-01 17:17:21.767] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.769] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 [2023-09-01 17:17:21.825] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /, total: 2136997888 avail: 1564868608 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /dev, total: 8311140352 avail: 8311140352 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /dev/shm, total: 8328564736 avail: 8328564 736 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /run, total: 8328564736 avail: 7522344960 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 8328564736 avail: 8 328564736 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /usr, total: 8579448832 avail: 3967885312 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /boot, total: 2111832064 avail: 1924816896 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /opt, total: 8579448832 avail: 5361532928 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /backup, total: 21464350720 avail: 2143056 6912 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /home, total: 2136997888 avail: 1688887296 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /var, total: 2136997888 avail: 671993856 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /tmp, total: 2136997888 avail: 2026397696 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /run/user/42, total: 1665716224 avail: 166 5703936 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 692 35937280 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /run/user/0, total: 1665716224 avail: 1665 716224 [2023-09-01 17:17:21.826] [DEBUG] -- get disk info for path /run/user/1002, total: 1665716224 avail: 1 665716224 [2023-09-01 17:17:21.827] [DEBUG] -- get disk info for path /run/user/1003, total: 1665716224 avail: 1 665716224 [2023-09-01 17:17:21.827] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/ocean base/observer2/redo/clog [2023-09-01 17:17:21.873] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.874] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 692 35937280 [2023-09-01 17:17:21.874] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/ocean base/observer2/data [2023-09-01 17:17:21.923] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.924] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 692 35937280 [2023-09-01 17:17:21.924] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/ocean base/observer1/redo/clog [2023-09-01 17:17:21.975] [DEBUG] -- exited code 0 [2023-09-01 17:17:21.975] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 692 35937280 [2023-09-01 17:17:21.975] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/ocean base/observer3/data [2023-09-01 17:17:22.025] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.025] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 692 35937280 [2023-09-01 17:17:22.026] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/ocean base/observer3/redo/clog [2023-09-01 17:17:22.077] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.077] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 692 35937280 [2023-09-01 17:17:22.077] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/ocean base/observer1/data [2023-09-01 17:17:22.125] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.125] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 692 35937280 [2023-09-01 17:17:22.126] [DEBUG] -- disk: {'/': {'total': 2136997888, 'avail': 1564868608, 'need': 0, 'threshold': 2}, '/dev': {'total': 8311140352, 'avail': 8311140352, 'need': 0, 'threshold': 2}, '/dev /shm': {'total': 8328564736, 'avail': 8328564736, 'need': 0, 'threshold': 2}, '/run': {'total': 832856 4736, 'avail': 7522344960, 'need': 0, 'threshold': 2}, '/sys/fs/cgroup': {'total': 8328564736, 'avail' : 8328564736, 'need': 0, 'threshold': 2}, '/usr': {'total': 8579448832, 'avail': 3967885312, 'need': 0 , 'threshold': 2}, '/boot': {'total': 2111832064, 'avail': 1924816896, 'need': 0, 'threshold': 2}, '/o pt': {'total': 8579448832, 'avail': 5361532928, 'need': 0, 'threshold': 2}, '/backup': {'total': 21464 350720, 'avail': 21430566912, 'need': 0, 'threshold': 2}, '/home': {'total': 2136997888, 'avail': 1688 887296, 'need': 0, 'threshold': 2}, '/var': {'total': 2136997888, 'avail': 671993856, 'need': 0, 'thre shold': 2}, '/tmp': {'total': 2136997888, 'avail': 2026397696, 'need': 0, 'threshold': 2}, '/run/user/ 42': {'total': 1665716224, 'avail': 1665703936, 'need': 0, 'threshold': 2}, '/home/soar': {'total': 10 6248536064, 'avail': 69235937280, 'need': 0, 'threshold': 2}, '/run/user/0': {'total': 1665716224, 'av ail': 1665716224, 'need': 0, 'threshold': 2}, '/run/user/1002': {'total': 1665716224, 'avail': 1665716 224, 'need': 0, 'threshold': 2}, '/run/user/1003': {'total': 1665716224, 'avail': 1665716224, 'need': 0, 'threshold': 2}} [2023-09-01 17:17:22.126] [WARNING] OBD-1012: (96.0.221.160) clog and data use the same disk (/home/so ar) [2023-09-01 17:17:22.126] [WARNING] OBD-1012: (96.0.221.160) clog and data use the same disk (/home/so ar) [2023-09-01 17:17:22.126] [WARNING] OBD-1012: (96.0.221.160) clog and data use the same disk (/home/so ar) [2023-09-01 17:17:22.126] [DEBUG] -- admin@96.0.221.160 execute: date +%s%N [2023-09-01 17:17:22.176] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.177] [DEBUG] -- 96.0.221.160 time delta -2.442626953125 [2023-09-01 17:17:22.256] [INFO] [WARN] OBD-1012: (96.0.221.160) clog and data use the same disk (/hom e/soar) [2023-09-01 17:17:22.256] [INFO] [WARN] OBD-1012: (96.0.221.160) clog and data use the same disk (/hom e/soar) [2023-09-01 17:17:22.256] [INFO] [WARN] OBD-1012: (96.0.221.160) clog and data use the same disk (/hom e/soar) [2023-09-01 17:17:22.257] [INFO] [2023-09-01 17:17:22.257] [DEBUG] - sub start_check ref count to 0 [2023-09-01 17:17:22.257] [DEBUG] - export start_check [2023-09-01 17:17:22.257] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0-5 .el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-09-01 17:17:22.257] [DEBUG] - import start_check [2023-09-01 17:17:22.261] [DEBUG] - add start_check ref count to 1 [2023-09-01 17:17:22.262] [INFO] Check before start obproxy [2023-09-01 17:17:22.263] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/obproxy/run/ obproxy-96.0.221.160-2883.pid [2023-09-01 17:17:22.274] [DEBUG] -- exited code 1, error output: [2023-09-01 17:17:22.274] [DEBUG] cat: /home/soar/oceanbase/obproxy/run/obproxy-96.0.221.160-2883.pid: No such file or directory [2023-09-01 17:17:22.274] [DEBUG] [2023-09-01 17:17:22.275] [DEBUG] -- 96.0.221.160 port check [2023-09-01 17:17:22.275] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-09-01 17:17:22.330] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.330] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-09-01 17:17:22.384] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.395] [DEBUG] - sub start_check ref count to 0 [2023-09-01 17:17:22.395] [DEBUG] - export start_check [2023-09-01 17:17:22.395] [DEBUG] - Call oceanbase-ce-py_script_start-3.1.0 for oceanbase-ce-3.1.5-100 010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795 [2023-09-01 17:17:22.395] [DEBUG] - import start [2023-09-01 17:17:22.399] [DEBUG] - add start ref count to 1 [2023-09-01 17:17:22.400] [INFO] Start observer [2023-09-01 17:17:22.401] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer1/dat a/ilog/ [2023-09-01 17:17:22.410] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.411] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer1/oc eanbase/run/observer.pid [2023-09-01 17:17:22.462] [DEBUG] -- exited code 1, error output: [2023-09-01 17:17:22.462] [DEBUG] cat: /home/soar/oceanbase/observer1/oceanbase/run/observer.pid: No s uch file or directory [2023-09-01 17:17:22.462] [DEBUG] [2023-09-01 17:17:22.462] [DEBUG] -- server1(96.0.221.160) start command construction [2023-09-01 17:17:22.463] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer2/dat a/ilog/ [2023-09-01 17:17:22.471] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.471] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer2/oc eanbase/run/observer.pid [2023-09-01 17:17:22.519] [DEBUG] -- exited code 1, error output: [2023-09-01 17:17:22.520] [DEBUG] cat: /home/soar/oceanbase/observer2/oceanbase/run/observer.pid: No s uch file or directory [2023-09-01 17:17:22.520] [DEBUG] [2023-09-01 17:17:22.520] [DEBUG] -- server2(96.0.221.160) start command construction [2023-09-01 17:17:22.521] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer3/dat a/ilog/ [2023-09-01 17:17:22.531] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.531] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer3/oc eanbase/run/observer.pid [2023-09-01 17:17:22.576] [DEBUG] -- exited code 1, error output: [2023-09-01 17:17:22.576] [DEBUG] cat: /home/soar/oceanbase/observer3/oceanbase/run/observer.pid: No s uch file or directory [2023-09-01 17:17:22.577] [DEBUG] [2023-09-01 17:17:22.577] [DEBUG] -- server3(96.0.221.160) start command construction [2023-09-01 17:17:22.577] [DEBUG] -- starting server1(96.0.221.160) observer [2023-09-01 17:17:22.578] [DEBUG] -- admin@96.0.221.160 set env LD_LIBRARY_PATH to '/home/soar/oceanba se/observer1/oceanbase/lib:' [2023-09-01 17:17:22.578] [DEBUG] -- admin@96.0.221.160 execute: cd /home/soar/oceanbase/observer1/oce anbase; /home/soar/oceanbase/observer1/oceanbase/bin/observer -r '96.0.221.160:2882:2881;96.0.221.160: 3882:3881;96.0.221.160:4882:4881' -p 2881 -P 2882 -z 'zone1' -n 'obcluster' -c 1 -d '/home/soar/oceanb ase/observer1/data' -i 'ens192' -l 'INFO' -o __min_full_resource_pool_memory=268435456,memory_limit='1 G',system_memory='512M',datafile_size='5G',log_disk_size='6G',cpu_count=16,production_mode=False,enabl e_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4 [2023-09-01 17:17:22.754] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.754] [DEBUG] -- admin@96.0.221.160 delete env LD_LIBRARY_PATH [2023-09-01 17:17:22.755] [DEBUG] -- starting server2(96.0.221.160) observer [2023-09-01 17:17:22.755] [DEBUG] -- admin@96.0.221.160 set env LD_LIBRARY_PATH to '/home/soar/oceanba se/observer2/oceanbase/lib:' [2023-09-01 17:17:22.755] [DEBUG] -- admin@96.0.221.160 execute: cd /home/soar/oceanbase/observer2/oce anbase; /home/soar/oceanbase/observer2/oceanbase/bin/observer -r '96.0.221.160:2882:2881;96.0.221.160: 3882:3881;96.0.221.160:4882:4881' -p 3881 -P 3882 -z 'zone2' -n 'obcluster' -c 1 -d '/home/soar/oceanb ase/observer2/data' -i 'ens192' -l 'INFO' -o __min_full_resource_pool_memory=268435456,memory_limit='1 G',system_memory='512M',datafile_size='5G',log_disk_size='6G',cpu_count=16,production_mode=False,enabl e_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4 [2023-09-01 17:17:22.910] [DEBUG] -- exited code 0 [2023-09-01 17:17:22.910] [DEBUG] -- admin@96.0.221.160 delete env LD_LIBRARY_PATH [2023-09-01 17:17:22.911] [DEBUG] -- starting server3(96.0.221.160) observer [2023-09-01 17:17:22.911] [DEBUG] -- admin@96.0.221.160 set env LD_LIBRARY_PATH to '/home/soar/oceanba se/observer3/oceanbase/lib:' [2023-09-01 17:17:22.911] [DEBUG] -- admin@96.0.221.160 execute: cd /home/soar/oceanbase/observer3/oce anbase; /home/soar/oceanbase/observer3/oceanbase/bin/observer -r '96.0.221.160:2882:2881;96.0.221.160: 3882:3881;96.0.221.160:4882:4881' -p 4881 -P 4882 -z 'zone3' -n 'obcluster' -c 1 -d '/home/soar/oceanb ase/observer3/data' -i 'ens192' -l 'INFO' -o __min_full_resource_pool_memory=268435456,memory_limit='1 G',system_memory='512M',datafile_size='5G',log_disk_size='6G',cpu_count=16,production_mode=False,enabl e_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4 [2023-09-01 17:17:23.067] [DEBUG] -- exited code 0 [2023-09-01 17:17:23.068] [DEBUG] -- admin@96.0.221.160 delete env LD_LIBRARY_PATH [2023-09-01 17:17:23.186] [INFO] observer program health check [2023-09-01 17:17:26.188] [DEBUG] -- server1(96.0.221.160) program health check [2023-09-01 17:17:26.189] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer1/oc eanbase/run/observer.pid [2023-09-01 17:17:26.200] [DEBUG] -- exited code 1, error output: [2023-09-01 17:17:26.200] [DEBUG] cat: /home/soar/oceanbase/observer1/oceanbase/run/observer.pid: No s uch file or directory [2023-09-01 17:17:26.200] [DEBUG] [2023-09-01 17:17:26.200] [DEBUG] -- server2(96.0.221.160) program health check [2023-09-01 17:17:26.200] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer2/oc eanbase/run/observer.pid [2023-09-01 17:17:26.208] [DEBUG] -- exited code 1, error output: [2023-09-01 17:17:26.208] [DEBUG] cat: /home/soar/oceanbase/observer2/oceanbase/run/observer.pid: No s uch file or directory [2023-09-01 17:17:26.208] [DEBUG] [2023-09-01 17:17:26.208] [DEBUG] -- server3(96.0.221.160) program health check [2023-09-01 17:17:26.208] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer3/oc eanbase/run/observer.pid [2023-09-01 17:17:26.215] [DEBUG] -- exited code 1, error output: [2023-09-01 17:17:26.215] [DEBUG] cat: /home/soar/oceanbase/observer3/oceanbase/run/observer.pid: No s uch file or directory [2023-09-01 17:17:26.215] [DEBUG] [2023-09-01 17:17:26.322] [WARNING] OBD-2002: Failed to start server1(96.0.221.160) observer [2023-09-01 17:17:26.322] [WARNING] OBD-2002: Failed to start server2(96.0.221.160) observer [2023-09-01 17:17:26.322] [WARNING] OBD-2002: Failed to start server3(96.0.221.160) observer [2023-09-01 17:17:26.323] [DEBUG] - sub start ref count to 0 [2023-09-01 17:17:26.323] [DEBUG] - export start [2023-09-01 17:17:26.323] [ERROR] oceanbase-ce start failed [2023-09-01 17:17:26.328] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-09-01 17:17:26.328] [INFO] Trace ID: 59d161c4-48a8-11ee-b5d5-0050569c579a [2023-09-01 17:17:26.328] [INFO] If you want to view detailed obd logs, please run: obd display-trace 59d161c4-48a8-11ee-b5d5-0050569c579a [2023-09-01 17:17:26.329] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-09-01 17:17:26.329] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-09-01 17:17:26.329] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-09-01 17:17:26.330] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_obce-3n release, count 0 [2023-09-01 17:17:26.330] [DEBUG] - unlock /home/admin/.obd/lock/deploy_obce-3n [2023-09-01 17:17:26.330] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-09-01 17:17:26.330] [DEBUG] - unlock /home/admin/.obd/lock/global