-bash-4.2$ obd display-trace 6067ace8-488d-11ee-ae24-0050569c579a
[2023-09-01 14:04:14.006] [DEBUG] - cmd: ['obce-3n']
[2023-09-01 14:04:14.006] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None}
[2023-09-01 14:04:14.006] [DEBUG] - mkdir /home/admin/.obd/lock/
[2023-09-01 14:04:14.006] [DEBUG] - unknown lock mode
[2023-09-01 14:04:14.006] [DEBUG] - try to get share lock /home/admin/.obd/lock/global
[2023-09-01 14:04:14.007] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1
[2023-09-01 14:04:14.007] [DEBUG] - Get Deploy by name
[2023-09-01 14:04:14.007] [DEBUG] - mkdir /home/admin/.obd/cluster/
[2023-09-01 14:04:14.007] [DEBUG] - mkdir /home/admin/.obd/config_parser/
[2023-09-01 14:04:14.007] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_obce-3n
[2023-09-01 14:04:14.007] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_obce-3n`, count 1
[2023-09-01 14:04:14.011] [DEBUG] - Deploy status judge
[2023-09-01 14:04:14.011] [INFO] Get local repositories
[2023-09-01 14:04:14.012] [DEBUG] - mkdir /home/admin/.obd/repository
[2023-09-01 14:04:14.012] [DEBUG] - Get local repository oceanbase-ce-3.1.5-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:14.012] [DEBUG] - Search repository oceanbase-ce version: 3.1.5, tag: 1ac7ca847d4d1461ecd4da18484a823cc0508795, release: None, package_hash: None
[2023-09-01 14:04:14.013] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo
[2023-09-01 14:04:14.013] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1
[2023-09-01 14:04:14.013] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce
[2023-09-01 14:04:14.014] [DEBUG] - Found repository oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:14.014] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3
[2023-09-01 14:04:14.015] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: de53232a951184fad75b15884458d85e31d2f6c3, release: None, package_hash: None
[2023-09-01 14:04:14.015] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2
[2023-09-01 14:04:14.015] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce
[2023-09-01 14:04:14.016] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3
[2023-09-01 14:04:14.147] [DEBUG] - Get deploy config
[2023-09-01 14:04:14.173] [INFO] Search plugins
[2023-09-01 14:04:14.173] [DEBUG] - Searching start_check plugin for components ...
[2023-09-01 14:04:14.173] [DEBUG] - Searching start_check plugin for oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:14.173] [DEBUG] - mkdir /home/admin/.obd/plugins
[2023-09-01 14:04:14.175] [DEBUG] - Found for oceanbase-ce-py_script_start_check-3.1.0 for oceanbase-ce-3.1.5
[2023-09-01 14:04:14.175] [DEBUG] - Searching start_check plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3
[2023-09-01 14:04:14.175] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0
[2023-09-01 14:04:14.175] [DEBUG] - Searching create_tenant plugin for components ...
[2023-09-01 14:04:14.175] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:14.175] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-3.1.0 for oceanbase-ce-3.1.5
[2023-09-01 14:04:14.175] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3
[2023-09-01 14:04:14.175] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.0.0
[2023-09-01 14:04:14.175] [DEBUG] - Searching start plugin for components ...
[2023-09-01 14:04:14.176] [DEBUG] - Searching start plugin for oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:14.176] [DEBUG] - Found for oceanbase-ce-py_script_start-3.1.0 for oceanbase-ce-3.1.5
[2023-09-01 14:04:14.176] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3
[2023-09-01 14:04:14.176] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0
[2023-09-01 14:04:14.176] [DEBUG] - Searching connect plugin for components ...
[2023-09-01 14:04:14.176] [DEBUG] - Searching connect plugin for oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:14.177] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-3.1.5
[2023-09-01 14:04:14.177] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3
[2023-09-01 14:04:14.177] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0
[2023-09-01 14:04:14.177] [DEBUG] - Searching bootstrap plugin for components ...
[2023-09-01 14:04:14.177] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:14.177] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-3.1.0 for oceanbase-ce-3.1.5
[2023-09-01 14:04:14.177] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3
[2023-09-01 14:04:14.177] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0
[2023-09-01 14:04:14.177] [DEBUG] - Searching display plugin for components ...
[2023-09-01 14:04:14.177] [DEBUG] - Searching display plugin for oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:14.178] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-3.1.5
[2023-09-01 14:04:14.178] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3
[2023-09-01 14:04:14.178] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0
[2023-09-01 14:04:14.306] [INFO] Open ssh connection
[2023-09-01 14:04:14.832] [INFO] Load cluster param plugin
[2023-09-01 14:04:14.833] [DEBUG] - Searching param plugin for components ...
[2023-09-01 14:04:14.833] [DEBUG] - Search param plugin for oceanbase-ce
[2023-09-01 14:04:14.834] [DEBUG] - Found for oceanbase-ce-param-3.1.0 for oceanbase-ce-3.1.5
[2023-09-01 14:04:14.834] [DEBUG] - Applying oceanbase-ce-param-3.1.0 for oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:15.419] [DEBUG] - Search param plugin for obproxy-ce
[2023-09-01 14:04:15.420] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0
[2023-09-01 14:04:15.420] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3
[2023-09-01 14:04:15.706] [DEBUG] - Call oceanbase-ce-py_script_start_check-3.1.0 for oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:15.706] [DEBUG] - import start_check
[2023-09-01 14:04:15.716] [DEBUG] - add start_check ref count to 1
[2023-09-01 14:04:15.718] [INFO] Check before start observer
[2023-09-01 14:04:15.719] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer1/oceanbase/run/observer.pid
[2023-09-01 14:04:15.729] [DEBUG] -- exited code 1, error output:
[2023-09-01 14:04:15.729] [DEBUG] cat: /home/soar/oceanbase/observer1/oceanbase/run/observer.pid: No such file or directory
[2023-09-01 14:04:15.729] [DEBUG]
[2023-09-01 14:04:15.729] [DEBUG] -- server1(96.0.221.160) port check
[2023-09-01 14:04:15.729] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq
[2023-09-01 14:04:15.781] [DEBUG] -- exited code 0
[2023-09-01 14:04:15.781] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq
[2023-09-01 14:04:15.833] [DEBUG] -- exited code 0
[2023-09-01 14:04:15.834] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer1/data/sstable/block_file
[2023-09-01 14:04:15.880] [DEBUG] -- exited code 2, error output:
[2023-09-01 14:04:15.881] [DEBUG] ls: cannot access /home/soar/oceanbase/observer1/data/sstable/block_file: No such file or directory
[2023-09-01 14:04:15.881] [DEBUG]
[2023-09-01 14:04:15.881] [DEBUG] -- admin@96.0.221.160 execute: grep -e '^ *ens192:' /proc/net/dev
[2023-09-01 14:04:15.929] [DEBUG] -- exited code 0
[2023-09-01 14:04:15.930] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer2/oceanbase/run/observer.pid
[2023-09-01 14:04:15.941] [DEBUG] -- exited code 1, error output:
[2023-09-01 14:04:15.941] [DEBUG] cat: /home/soar/oceanbase/observer2/oceanbase/run/observer.pid: No such file or directory
[2023-09-01 14:04:15.941] [DEBUG]
[2023-09-01 14:04:15.941] [DEBUG] -- server2(96.0.221.160) port check
[2023-09-01 14:04:15.941] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0F29' | awk -F' ' '{print $2}' | uniq
[2023-09-01 14:04:15.994] [DEBUG] -- exited code 0
[2023-09-01 14:04:15.995] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0F2A' | awk -F' ' '{print $2}' | uniq
[2023-09-01 14:04:16.051] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.052] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer2/data/sstable/block_file
[2023-09-01 14:04:16.104] [DEBUG] -- exited code 2, error output:
[2023-09-01 14:04:16.104] [DEBUG] ls: cannot access /home/soar/oceanbase/observer2/data/sstable/block_file: No such file or directory
[2023-09-01 14:04:16.104] [DEBUG]
[2023-09-01 14:04:16.105] [DEBUG] -- admin@96.0.221.160 execute: grep -e '^ *ens192:' /proc/net/dev
[2023-09-01 14:04:16.157] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.159] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer3/oceanbase/run/observer.pid
[2023-09-01 14:04:16.169] [DEBUG] -- exited code 1, error output:
[2023-09-01 14:04:16.169] [DEBUG] cat: /home/soar/oceanbase/observer3/oceanbase/run/observer.pid: No such file or directory
[2023-09-01 14:04:16.170] [DEBUG]
[2023-09-01 14:04:16.170] [DEBUG] -- server3(96.0.221.160) port check
[2023-09-01 14:04:16.170] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1311' | awk -F' ' '{print $2}' | uniq
[2023-09-01 14:04:16.220] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.220] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1312' | awk -F' ' '{print $2}' | uniq
[2023-09-01 14:04:16.277] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.277] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer3/data/sstable/block_file
[2023-09-01 14:04:16.325] [DEBUG] -- exited code 2, error output:
[2023-09-01 14:04:16.325] [DEBUG] ls: cannot access /home/soar/oceanbase/observer3/data/sstable/block_file: No such file or directory
[2023-09-01 14:04:16.325] [DEBUG]
[2023-09-01 14:04:16.325] [DEBUG] -- admin@96.0.221.160 execute: grep -e '^ *ens192:' /proc/net/dev
[2023-09-01 14:04:16.375] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.375] [DEBUG] -- admin@96.0.221.160 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr
[2023-09-01 14:04:16.424] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.425] [DEBUG] -- admin@96.0.221.160 execute: ulimit -a
[2023-09-01 14:04:16.473] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.474] [DEBUG] -- admin@96.0.221.160 execute: cat /proc/meminfo
[2023-09-01 14:04:16.523] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.523] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024
[2023-09-01 14:04:16.573] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.574] [DEBUG] -- get disk info for path /, total: 2136997888 avail: 1564893184
[2023-09-01 14:04:16.574] [DEBUG] -- get disk info for path /dev, total: 8311140352 avail: 8311140352
[2023-09-01 14:04:16.574] [DEBUG] -- get disk info for path /dev/shm, total: 8328564736 avail: 8328564736
[2023-09-01 14:04:16.574] [DEBUG] -- get disk info for path /run, total: 8328564736 avail: 7539122176
[2023-09-01 14:04:16.574] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 8328564736 avail: 8328564736
[2023-09-01 14:04:16.574] [DEBUG] -- get disk info for path /usr, total: 8579448832 avail: 3967885312
[2023-09-01 14:04:16.574] [DEBUG] -- get disk info for path /boot, total: 2111832064 avail: 1924816896
[2023-09-01 14:04:16.574] [DEBUG] -- get disk info for path /opt, total: 8579448832 avail: 5361532928
[2023-09-01 14:04:16.574] [DEBUG] -- get disk info for path /backup, total: 21464350720 avail: 21430566912
[2023-09-01 14:04:16.575] [DEBUG] -- get disk info for path /home, total: 2136997888 avail: 1688965120
[2023-09-01 14:04:16.575] [DEBUG] -- get disk info for path /var, total: 2136997888 avail: 668295168
[2023-09-01 14:04:16.575] [DEBUG] -- get disk info for path /tmp, total: 2136997888 avail: 2026405888
[2023-09-01 14:04:16.575] [DEBUG] -- get disk info for path /run/user/42, total: 1665716224 avail: 1665703936
[2023-09-01 14:04:16.575] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 69238837248
[2023-09-01 14:04:16.575] [DEBUG] -- get disk info for path /run/user/0, total: 1665716224 avail: 1665716224
[2023-09-01 14:04:16.575] [DEBUG] -- get disk info for path /run/user/1002, total: 1665716224 avail: 1665716224
[2023-09-01 14:04:16.575] [DEBUG] -- get disk info for path /run/user/1003, total: 1665716224 avail: 1665716224
[2023-09-01 14:04:16.575] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/oceanbase/observer1/redo/clog
[2023-09-01 14:04:16.623] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.623] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 69238837248
[2023-09-01 14:04:16.623] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/oceanbase/observer3/data
[2023-09-01 14:04:16.670] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.670] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 69238837248
[2023-09-01 14:04:16.670] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/oceanbase/observer2/data
[2023-09-01 14:04:16.717] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.717] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 69238837248
[2023-09-01 14:04:16.718] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/oceanbase/observer2/redo/clog
[2023-09-01 14:04:16.767] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.768] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 69238837248
[2023-09-01 14:04:16.768] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/oceanbase/observer3/redo/clog
[2023-09-01 14:04:16.816] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.816] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 69238837248
[2023-09-01 14:04:16.817] [DEBUG] -- admin@96.0.221.160 execute: df --block-size=1024 /home/soar/oceanbase/observer1/data
[2023-09-01 14:04:16.866] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.866] [DEBUG] -- get disk info for path /home/soar, total: 106248536064 avail: 69238837248
[2023-09-01 14:04:16.866] [DEBUG] -- disk: {'/': {'total': 2136997888, 'avail': 1564893184, 'need': 0, 'threshold': 2}, '/dev': {'total': 8311140352, 'avail': 8311140352, 'need': 0, 'threshold': 2}, '/dev/shm': {'total': 8328564736, 'avail': 8328564736, 'need': 0, 'threshold': 2}, '/run': {'total': 8328564736, 'avail': 7539122176, 'need': 0, 'threshold': 2}, '/sys/fs/cgroup': {'total': 8328564736, 'avail': 8328564736, 'need': 0, 'threshold': 2}, '/usr': {'total': 8579448832, 'avail': 3967885312, 'need': 0, 'threshold': 2}, '/boot': {'total': 2111832064, 'avail': 1924816896, 'need': 0, 'threshold': 2}, '/opt': {'total': 8579448832, 'avail': 5361532928, 'need': 0, 'threshold': 2}, '/backup': {'total': 21464350720, 'avail': 21430566912, 'need': 0, 'threshold': 2}, '/home': {'total': 2136997888, 'avail': 1688965120, 'need': 0, 'threshold': 2}, '/var': {'total': 2136997888, 'avail': 668295168, 'need': 0, 'threshold': 2}, '/tmp': {'total': 2136997888, 'avail': 2026405888, 'need': 0, 'threshold': 2}, '/run/user/42': {'total': 1665716224, 'avail': 1665703936, 'need': 0, 'threshold': 2}, '/home/soar': {'total': 106248536064, 'avail': 69238837248, 'need': 0, 'threshold': 2}, '/run/user/0': {'total': 1665716224, 'avail': 1665716224, 'need': 0, 'threshold': 2}, '/run/user/1002': {'total': 1665716224, 'avail': 1665716224, 'need': 0, 'threshold': 2}, '/run/user/1003': {'total': 1665716224, 'avail': 1665716224, 'need': 0, 'threshold': 2}}
[2023-09-01 14:04:16.866] [WARNING] OBD-1012: (96.0.221.160) clog and data use the same disk (/home/soar)
[2023-09-01 14:04:16.866] [WARNING] OBD-1012: (96.0.221.160) clog and data use the same disk (/home/soar)
[2023-09-01 14:04:16.866] [WARNING] OBD-1012: (96.0.221.160) clog and data use the same disk (/home/soar)
[2023-09-01 14:04:16.867] [DEBUG] -- admin@96.0.221.160 execute: date +%s%N
[2023-09-01 14:04:16.914] [DEBUG] -- exited code 0
[2023-09-01 14:04:16.914] [DEBUG] -- 96.0.221.160 time delta -1.304443359375
[2023-09-01 14:04:17.025] [INFO] [WARN] OBD-1012: (96.0.221.160) clog and data use the same disk (/home/soar)
[2023-09-01 14:04:17.026] [INFO] [WARN] OBD-1012: (96.0.221.160) clog and data use the same disk (/home/soar)
[2023-09-01 14:04:17.026] [INFO] [WARN] OBD-1012: (96.0.221.160) clog and data use the same disk (/home/soar)
[2023-09-01 14:04:17.026] [INFO]
[2023-09-01 14:04:17.026] [DEBUG] - sub start_check ref count to 0
[2023-09-01 14:04:17.026] [DEBUG] - export start_check
[2023-09-01 14:04:17.027] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3
[2023-09-01 14:04:17.027] [DEBUG] - import start_check
[2023-09-01 14:04:17.031] [DEBUG] - add start_check ref count to 1
[2023-09-01 14:04:17.032] [INFO] Check before start obproxy
[2023-09-01 14:04:17.034] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/obproxy/run/obproxy-96.0.221.160-2883.pid
[2023-09-01 14:04:17.041] [DEBUG] -- exited code 1, error output:
[2023-09-01 14:04:17.041] [DEBUG] cat: /home/soar/oceanbase/obproxy/run/obproxy-96.0.221.160-2883.pid: No such file or directory
[2023-09-01 14:04:17.041] [DEBUG]
[2023-09-01 14:04:17.042] [DEBUG] -- 96.0.221.160 port check
[2023-09-01 14:04:17.042] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq
[2023-09-01 14:04:17.095] [DEBUG] -- exited code 0
[2023-09-01 14:04:17.095] [DEBUG] -- admin@96.0.221.160 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq
[2023-09-01 14:04:17.147] [DEBUG] -- exited code 0
[2023-09-01 14:04:17.164] [DEBUG] - sub start_check ref count to 0
[2023-09-01 14:04:17.164] [DEBUG] - export start_check
[2023-09-01 14:04:17.164] [DEBUG] - Call oceanbase-ce-py_script_start-3.1.0 for oceanbase-ce-3.1.5-100010012023060910.el7-1ac7ca847d4d1461ecd4da18484a823cc0508795
[2023-09-01 14:04:17.165] [DEBUG] - import start
[2023-09-01 14:04:17.169] [DEBUG] - add start ref count to 1
[2023-09-01 14:04:17.170] [INFO] Start observer
[2023-09-01 14:04:17.172] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer1/data/ilog/
[2023-09-01 14:04:17.180] [DEBUG] -- exited code 0
[2023-09-01 14:04:17.180] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer1/oceanbase/run/observer.pid
[2023-09-01 14:04:17.230] [DEBUG] -- exited code 1, error output:
[2023-09-01 14:04:17.230] [DEBUG] cat: /home/soar/oceanbase/observer1/oceanbase/run/observer.pid: No such file or directory
[2023-09-01 14:04:17.230] [DEBUG]
[2023-09-01 14:04:17.231] [DEBUG] -- server1(96.0.221.160) start command construction
[2023-09-01 14:04:17.232] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer2/data/ilog/
[2023-09-01 14:04:17.243] [DEBUG] -- exited code 0
[2023-09-01 14:04:17.243] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer2/oceanbase/run/observer.pid
[2023-09-01 14:04:17.292] [DEBUG] -- exited code 1, error output:
[2023-09-01 14:04:17.292] [DEBUG] cat: /home/soar/oceanbase/observer2/oceanbase/run/observer.pid: No such file or directory
[2023-09-01 14:04:17.292] [DEBUG]
[2023-09-01 14:04:17.292] [DEBUG] -- server2(96.0.221.160) start command construction
[2023-09-01 14:04:17.292] [DEBUG] -- admin@96.0.221.160 execute: ls /home/soar/oceanbase/observer3/data/ilog/
[2023-09-01 14:04:17.300] [DEBUG] -- exited code 0
[2023-09-01 14:04:17.300] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer3/oceanbase/run/observer.pid
[2023-09-01 14:04:17.352] [DEBUG] -- exited code 1, error output:
[2023-09-01 14:04:17.352] [DEBUG] cat: /home/soar/oceanbase/observer3/oceanbase/run/observer.pid: No such file or directory
[2023-09-01 14:04:17.353] [DEBUG]
[2023-09-01 14:04:17.353] [DEBUG] -- server3(96.0.221.160) start command construction
[2023-09-01 14:04:17.353] [DEBUG] -- starting server1(96.0.221.160) observer
[2023-09-01 14:04:17.354] [DEBUG] -- admin@96.0.221.160 set env LD_LIBRARY_PATH to '/home/soar/oceanbase/observer1/oceanbase/lib:'
[2023-09-01 14:04:17.354] [DEBUG] -- admin@96.0.221.160 execute: cd /home/soar/oceanbase/observer1/oceanbase; /home/soar/oceanbase/observer1/oceanbase/bin/observer -r '96.0.221.160:2882:2881;96.0.221.160:3882:3881;96.0.221.160:4882:4881' -p 2881 -P 2882 -z 'zone1' -n 'obcluster' -c 1 -d '/home/soar/oceanbase/observer1/data' -i 'ens192' -l 'INFO' -o __min_full_resource_pool_memory=268435456,memory_limit='1G',system_memory='512M',datafile_size='5G',log_disk_size='6G',cpu_count=16,production_mode=False,enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4
[2023-09-01 14:04:17.565] [DEBUG] -- exited code 0
[2023-09-01 14:04:17.565] [DEBUG] -- admin@96.0.221.160 delete env LD_LIBRARY_PATH
[2023-09-01 14:04:17.565] [DEBUG] -- starting server2(96.0.221.160) observer
[2023-09-01 14:04:17.566] [DEBUG] -- admin@96.0.221.160 set env LD_LIBRARY_PATH to '/home/soar/oceanbase/observer2/oceanbase/lib:'
[2023-09-01 14:04:17.566] [DEBUG] -- admin@96.0.221.160 execute: cd /home/soar/oceanbase/observer2/oceanbase; /home/soar/oceanbase/observer2/oceanbase/bin/observer -r '96.0.221.160:2882:2881;96.0.221.160:3882:3881;96.0.221.160:4882:4881' -p 3881 -P 3882 -z 'zone2' -n 'obcluster' -c 1 -d '/home/soar/oceanbase/observer2/data' -i 'ens192' -l 'INFO' -o __min_full_resource_pool_memory=268435456,memory_limit='1G',system_memory='512M',datafile_size='5G',log_disk_size='6G',cpu_count=16,production_mode=False,enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4
[2023-09-01 14:04:17.725] [DEBUG] -- exited code 0
[2023-09-01 14:04:17.725] [DEBUG] -- admin@96.0.221.160 delete env LD_LIBRARY_PATH
[2023-09-01 14:04:17.725] [DEBUG] -- starting server3(96.0.221.160) observer
[2023-09-01 14:04:17.726] [DEBUG] -- admin@96.0.221.160 set env LD_LIBRARY_PATH to '/home/soar/oceanbase/observer3/oceanbase/lib:'
[2023-09-01 14:04:17.726] [DEBUG] -- admin@96.0.221.160 execute: cd /home/soar/oceanbase/observer3/oceanbase; /home/soar/oceanbase/observer3/oceanbase/bin/observer -r '96.0.221.160:2882:2881;96.0.221.160:3882:3881;96.0.221.160:4882:4881' -p 4881 -P 4882 -z 'zone3' -n 'obcluster' -c 1 -d '/home/soar/oceanbase/observer3/data' -i 'ens192' -l 'INFO' -o __min_full_resource_pool_memory=268435456,memory_limit='1G',system_memory='512M',datafile_size='5G',log_disk_size='6G',cpu_count=16,production_mode=False,enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4
[2023-09-01 14:04:17.860] [DEBUG] -- exited code 0
[2023-09-01 14:04:17.861] [DEBUG] -- admin@96.0.221.160 delete env LD_LIBRARY_PATH
[2023-09-01 14:04:17.956] [INFO] observer program health check
[2023-09-01 14:04:20.961] [DEBUG] -- server1(96.0.221.160) program health check
[2023-09-01 14:04:20.961] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer1/oceanbase/run/observer.pid
[2023-09-01 14:04:20.972] [DEBUG] -- exited code 1, error output:
[2023-09-01 14:04:20.972] [DEBUG] cat: /home/soar/oceanbase/observer1/oceanbase/run/observer.pid: No such file or directory
[2023-09-01 14:04:20.972] [DEBUG]
[2023-09-01 14:04:20.972] [DEBUG] -- server2(96.0.221.160) program health check
[2023-09-01 14:04:20.972] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer2/oceanbase/run/observer.pid
[2023-09-01 14:04:20.980] [DEBUG] -- exited code 1, error output:
[2023-09-01 14:04:20.980] [DEBUG] cat: /home/soar/oceanbase/observer2/oceanbase/run/observer.pid: No such file or directory
[2023-09-01 14:04:20.980] [DEBUG]
[2023-09-01 14:04:20.980] [DEBUG] -- server3(96.0.221.160) program health check
[2023-09-01 14:04:20.980] [DEBUG] -- admin@96.0.221.160 execute: cat /home/soar/oceanbase/observer3/oceanbase/run/observer.pid
[2023-09-01 14:04:20.986] [DEBUG] -- exited code 1, error output:
[2023-09-01 14:04:20.986] [DEBUG] cat: /home/soar/oceanbase/observer3/oceanbase/run/observer.pid: No such file or directory
[2023-09-01 14:04:20.986] [DEBUG]
[2023-09-01 14:04:21.090] [WARNING] OBD-2002: Failed to start server1(96.0.221.160) observer
[2023-09-01 14:04:21.090] [WARNING] OBD-2002: Failed to start server2(96.0.221.160) observer
[2023-09-01 14:04:21.091] [WARNING] OBD-2002: Failed to start server3(96.0.221.160) observer
[2023-09-01 14:04:21.091] [DEBUG] - sub start ref count to 0
[2023-09-01 14:04:21.091] [DEBUG] - export start
[2023-09-01 14:04:21.091] [ERROR] oceanbase-ce start failed
[2023-09-01 14:04:21.096] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes .
[2023-09-01 14:04:21.096] [INFO] Trace ID: 6067ace8-488d-11ee-ae24-0050569c579a
[2023-09-01 14:04:21.096] [INFO] If you want to view detailed obd logs, please run: obd display-trace 6067ace8-488d-11ee-ae24-0050569c579a
[2023-09-01 14:04:21.097] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1
[2023-09-01 14:04:21.097] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0
[2023-09-01 14:04:21.097] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo
[2023-09-01 14:04:21.097] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_obce-3n release, count 0
[2023-09-01 14:04:21.097] [DEBUG] - unlock /home/admin/.obd/lock/deploy_obce-3n
[2023-09-01 14:04:21.097] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0
[2023-09-01 14:04:21.097] [DEBUG] - unlock /home/admin/.obd/lock/global