[root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# obd cluster destroy obclu1 Get local repositories ok Search plugins ok Open ssh connection ok Stop observer ok Stop obproxy ok Stop obagent ok Stop prometheus ok Stop grafana ok obclu1 stopped Search plugins ok Cluster status check ok observer work dir cleaning ok obproxy work dir cleaning ok obagent work dir cleaning ok prometheus work dir cleaning ok grafana work dir cleaning ok obclu1 destroyed [root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# obd cluster destroy obclu1 Get local repositories ok [ERROR] Deploy "obclu1" is destroyed. You could not destroy an undeployed cluster See https://www.oceanbase.com/product/ob-deployer/error-codes . [root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# [root@10-2-12-203 autodeploy]# obd cluster autodeploy obclu -c default-example.yaml -v - open /root/.obd/version for a+ - mkdir /root/.obd/lock/ - try to get share lock /root/.obd/lock/global - share lock `/root/.obd/lock/global`, count 1 - cmd: ['obclu'] - opts: {'config': 'default-example.yaml', 'force': None, 'clean': False, 'unuselibrepo': None, 'auto_create_tenant': None, 'force_delete': None, 'strict_check': None} - Get Deploy by name - mkdir /root/.obd/cluster/ - mkdir /root/.obd/config_parser/ - try to get exclusive lock /root/.obd/lock/deploy_obclu - exclusive lock `/root/.obd/lock/deploy_obclu`, count 1 - Create deploy by configuration path - exclusive lock `/root/.obd/lock/deploy_obclu`, count 2 - mkdir /root/.obd/cluster/obclu - copy default-example.yaml /root/.obd/cluster/obclu/config.yaml - Get deploy configuration - Search best suitable repository - Search package for components... - Get oceanbase-ce repository - mkdir /root/.obd/repository - Search repository oceanbase-ce version: None, tag: None, release: None, package_hash: None - try to get share lock /root/.obd/lock/mirror_and_repo - share lock `/root/.obd/lock/mirror_and_repo`, count 1 - mkdir /root/.obd/repository/oceanbase-ce - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - share lock `/root/.obd/lock/mirror_and_repo`, count 2 - Search oceanbase-ce package from mirror - mkdir /root/.obd/mirror - mkdir /root/.obd/mirror/remote - mkdir /root/.obd/mirror/local - try to get exclusive lock /root/.obd/lock/mirror_and_repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 1 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 2 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - open /root/.obd/mirror/remote/OceanBase.repo for r - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 3 - md5 is None - name is oceanbase-ce - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: oceanbase-ce version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: 1d56dc742f5f05a2d15797d291b51a94019e728d - get RPM package by name: oceanbase-ce version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: 1d56dc742f5f05a2d15797d291b51a94019e728d - Found Package oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - name: oceanbase-ce version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: 1d56dc742f5f05a2d15797d291b51a94019e728d as same as oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d, Use package name: oceanbase-ce version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: 1d56dc742f5f05a2d15797d291b51a94019e728d - Get obproxy-ce repository - Search repository obproxy-ce version: None, tag: None, release: None, package_hash: None - share lock `/root/.obd/lock/mirror_and_repo`, count 3 - mkdir /root/.obd/repository/obproxy-ce - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - share lock `/root/.obd/lock/mirror_and_repo`, count 4 - Search obproxy-ce package from mirror - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 4 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 5 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 6 - md5 is None - name is obproxy-ce - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: obproxy-ce version: 4.0.0 release:5.el7 arch: x86_64 md5: de53232a951184fad75b15884458d85e31d2f6c3 - get RPM package by name: obproxy-ce version: 4.0.0 release:5.el7 arch: x86_64 md5: de53232a951184fad75b15884458d85e31d2f6c3 - Found Package obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - name: obproxy-ce version: 4.0.0 release:5.el7 arch: x86_64 md5: de53232a951184fad75b15884458d85e31d2f6c3 as same as obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3, Use package name: obproxy-ce version: 4.0.0 release:5.el7 arch: x86_64 md5: de53232a951184fad75b15884458d85e31d2f6c3 - Get obagent repository - Search repository obagent version: None, tag: None, release: None, package_hash: None - share lock `/root/.obd/lock/mirror_and_repo`, count 5 - mkdir /root/.obd/repository/obagent - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - share lock `/root/.obd/lock/mirror_and_repo`, count 6 - Search obagent package from mirror - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 7 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 8 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 9 - md5 is None - name is obagent - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: obagent version: 1.2.0 release:4.el7 arch: x86_64 md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e - get RPM package by name: obagent version: 1.2.0 release:4.el7 arch: x86_64 md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Found Package obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - name: obagent version: 1.2.0 release:4.el7 arch: x86_64 md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e as same as obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e, Use package name: obagent version: 1.2.0 release:4.el7 arch: x86_64 md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Get prometheus repository - Search repository prometheus version: None, tag: None, release: None, package_hash: None - share lock `/root/.obd/lock/mirror_and_repo`, count 7 - mkdir /root/.obd/repository/prometheus - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - share lock `/root/.obd/lock/mirror_and_repo`, count 8 - Search prometheus package from mirror - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 10 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 11 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 12 - md5 is None - name is prometheus - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: prometheus version: 2.37.1 release:10000102022110211.el7 arch: x86_64 md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 - get RPM package by name: prometheus version: 2.37.1 release:10000102022110211.el7 arch: x86_64 md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 - Found Package prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - name: prometheus version: 2.37.1 release:10000102022110211.el7 arch: x86_64 md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 as same as prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263, Use package name: prometheus version: 2.37.1 release:10000102022110211.el7 arch: x86_64 md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 - Get grafana repository - Search repository grafana version: None, tag: None, release: None, package_hash: None - share lock `/root/.obd/lock/mirror_and_repo`, count 9 - mkdir /root/.obd/repository/grafana - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - share lock `/root/.obd/lock/mirror_and_repo`, count 10 - Search grafana package from mirror - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 13 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 14 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 15 - md5 is None - name is grafana - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: grafana version: 7.5.17 release:1 arch: x86_64 md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - get RPM package by name: grafana version: 7.5.17 release:1 arch: x86_64 md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Found Package grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - name: grafana version: 7.5.17 release:1 arch: x86_64 md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 as same as grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, Use package name: grafana version: 7.5.17 release:1 arch: x86_64 md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Searching install plugin for components ... - Searching install plugin for components ... - Search install plugin for oceanbase-ce - mkdir /root/.obd/plugins - Found for oceanbase-ce-install-4.0.0.0 for oceanbase-ce-4.0.0.0 - Search install plugin for obproxy-ce - Found for obproxy-ce-install-3.1.0 for obproxy-ce-4.0.0 - Search install plugin for obagent - Found for obagent-install-0.1 for obagent-1.2.0 - Search install plugin for prometheus - Found for prometheus-install-2.37.1 for prometheus-2.37.1 - Search install plugin for grafana - Found for grafana-install-7.5.17 for grafana-7.5.17 install oceanbase-ce-4.0.0.0 for local ok - get head repository - Search repository oceanbase-ce version: 4.0.0.0, tag: oceanbase-ce, release: None, package_hash: None - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - share lock `/root/.obd/lock/mirror_and_repo`, count 11 - head repository: oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d install obproxy-ce-4.0.0 for local ok - get head repository - Search repository obproxy-ce version: 4.0.0, tag: obproxy-ce, release: None, package_hash: None - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - share lock `/root/.obd/lock/mirror_and_repo`, count 12 - head repository: obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 install obagent-1.2.0 for local ok - get head repository - Search repository obagent version: 1.2.0, tag: obagent, release: None, package_hash: None - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - share lock `/root/.obd/lock/mirror_and_repo`, count 13 - head repository: obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e install prometheus-2.37.1 for local ok - get head repository - Search repository prometheus version: 2.37.1, tag: prometheus, release: None, package_hash: None - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - share lock `/root/.obd/lock/mirror_and_repo`, count 14 - head repository: prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 install grafana-7.5.17 for local ok - get head repository - Search repository grafana version: 7.5.17, tag: grafana, release: None, package_hash: None - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - share lock `/root/.obd/lock/mirror_and_repo`, count 15 - head repository: grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 Cluster param config check ok - Searching param plugin for components ... - Search param plugin for oceanbase-ce - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Search param plugin for obproxy-ce - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Search param plugin for obagent - Found for obagent-param-1.1.0 for obagent-1.2.0 - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Search param plugin for prometheus - Found for prometheus-param-2.37.1 for prometheus-2.37.1 - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Search param plugin for grafana - Found for grafana-param-7.5.17 for grafana-7.5.17 - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - server203(10.2.12.203) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check - server111(10.2.12.111) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check - server209(10.2.14.209) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check - 10.2.12.203 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 param check - host203(10.2.12.203) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check - host111(10.2.12.111) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check - host209(10.2.14.209) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check - 10.2.12.111 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 param check - 10.2.14.209 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 param check Open ssh connection ok - Searching generate_config plugin for components ... - Searching generate_config plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Found for oceanbase-ce-py_script_generate_config-4.0.0.0 for oceanbase-ce-4.0.0.0 - Searching generate_config plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Found for obproxy-ce-py_script_generate_config-3.1.0 for obproxy-ce-4.0.0 - Searching generate_config plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Found for obagent-py_script_generate_config-0.1 for obagent-1.2.0 - Searching generate_config plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Found for prometheus-py_script_generate_config-2.37.1 for prometheus-2.37.1 - Searching generate_config plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Found for grafana-py_script_generate_config-7.5.17 for grafana-7.5.17 - Call oceanbase-ce-py_script_generate_config-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - import generate_config - add generate_config ref count to 1 Generate observer configuration ok -- root@10.2.12.203 execute: cat /proc/net/dev -- exited code 0 -- root@10.2.12.203 execute: ping -W 1 -c 1 -I bond1 10.2.12.203 -- exited code 1, error output: -- root@10.2.12.203 execute: ping -W 1 -c 1 -I bond0 10.2.12.203 -- exited code 2, error output: connect: Network is unreachable -- root@10.2.12.203 execute: ping -W 1 -c 1 -I eth0 10.2.12.203 -- exited code 1, error output: ping: Warning: source address might be selected on device other than eth0. -- root@10.2.12.203 execute: ping -W 1 -c 1 -I eth1 10.2.12.203 -- exited code 1, error output: ping: Warning: source address might be selected on device other than eth1. -- root@10.2.12.203 execute: cat /proc/meminfo -- exited code 0 -- root@10.2.12.203 execute: grep -e 'processor\s*:' /proc/cpuinfo | wc -l -- exited code 0 -- root@10.2.12.203 execute: df --block-size=1024 -- exited code 0 -- root@10.2.12.203 execute: df --block-size=1024 /root/observer -- exited code 1, error output: df: ‘/root/observer’: No such file or directory -- root@10.2.12.203 execute: df --block-size=1024 /root -- exited code 0 -- root@10.2.12.203 execute: df --block-size=1024 /DATA/disk1/data -- exited code 1, error output: df: ‘/DATA/disk1/data’: No such file or directory -- root@10.2.12.203 execute: df --block-size=1024 /DATA/disk2/redo -- exited code 1, error output: df: ‘/DATA/disk2/redo’: No such file or directory -- root@10.2.12.203 execute: df --block-size=1024 /DATA/disk2/redo/clog -- exited code 1, error output: df: ‘/DATA/disk2/redo/clog’: No such file or directory -- root@10.2.12.203 execute: df --block-size=1024 /DATA/disk2/redo -- exited code 1, error output: df: ‘/DATA/disk2/redo’: No such file or directory -- root@10.2.12.111 execute: cat /proc/net/dev -- exited code 0 -- root@10.2.12.111 execute: ping -W 1 -c 1 -I bond1 10.2.12.111 -- exited code 1, error output: -- root@10.2.12.111 execute: ping -W 1 -c 1 -I bond0 10.2.12.111 -- exited code 2, error output: connect: Network is unreachable -- root@10.2.12.111 execute: ping -W 1 -c 1 -I eth0 10.2.12.111 -- exited code 1, error output: ping: Warning: source address might be selected on device other than eth0. -- root@10.2.12.111 execute: ping -W 1 -c 1 -I eth1 10.2.12.111 -- exited code 1, error output: ping: Warning: source address might be selected on device other than eth1. -- root@10.2.12.111 execute: cat /proc/meminfo -- exited code 0 -- root@10.2.12.111 execute: grep -e 'processor\s*:' /proc/cpuinfo | wc -l -- exited code 0 -- root@10.2.12.111 execute: df --block-size=1024 -- exited code 0 -- root@10.2.12.111 execute: df --block-size=1024 /root/observer -- exited code 1, error output: df: ‘/root/observer’: No such file or directory -- root@10.2.12.111 execute: df --block-size=1024 /root -- exited code 0 -- root@10.2.12.111 execute: df --block-size=1024 /DATA/disk1/data -- exited code 1, error output: df: ‘/DATA/disk1/data’: No such file or directory -- root@10.2.12.111 execute: df --block-size=1024 /DATA/disk2/redo -- exited code 1, error output: df: ‘/DATA/disk2/redo’: No such file or directory -- root@10.2.12.111 execute: df --block-size=1024 /DATA/disk2/redo/clog -- exited code 1, error output: df: ‘/DATA/disk2/redo/clog’: No such file or directory -- root@10.2.12.111 execute: df --block-size=1024 /DATA/disk2/redo -- exited code 1, error output: df: ‘/DATA/disk2/redo’: No such file or directory -- root@10.2.14.209 execute: cat /proc/net/dev -- exited code 0 -- root@10.2.14.209 execute: ping -W 1 -c 1 -I bond1 10.2.14.209 -- exited code 1, error output: -- root@10.2.14.209 execute: ping -W 1 -c 1 -I bond0 10.2.14.209 -- exited code 2, error output: connect: Network is unreachable -- root@10.2.14.209 execute: ping -W 1 -c 1 -I eth0 10.2.14.209 -- exited code 1, error output: ping: Warning: source address might be selected on device other than eth0. -- root@10.2.14.209 execute: ping -W 1 -c 1 -I eth1 10.2.14.209 -- exited code 1, error output: ping: Warning: source address might be selected on device other than eth1. -- root@10.2.14.209 execute: cat /proc/meminfo -- exited code 0 -- root@10.2.14.209 execute: grep -e 'processor\s*:' /proc/cpuinfo | wc -l -- exited code 0 -- root@10.2.14.209 execute: df --block-size=1024 -- exited code 0 -- root@10.2.14.209 execute: df --block-size=1024 /root/observer -- exited code 1, error output: df: ‘/root/observer’: No such file or directory -- root@10.2.14.209 execute: df --block-size=1024 /root -- exited code 0 -- root@10.2.14.209 execute: df --block-size=1024 /DATA/disk1/data -- exited code 1, error output: df: ‘/DATA/disk1/data’: No such file or directory -- root@10.2.14.209 execute: df --block-size=1024 /DATA/disk2/redo -- exited code 1, error output: df: ‘/DATA/disk2/redo’: No such file or directory -- root@10.2.14.209 execute: df --block-size=1024 /DATA/disk2/redo/clog -- exited code 1, error output: df: ‘/DATA/disk2/redo/clog’: No such file or directory -- root@10.2.14.209 execute: df --block-size=1024 /DATA/disk2/redo -- exited code 1, error output: df: ‘/DATA/disk2/redo’: No such file or directory - sub generate_config ref count to 0 - export generate_config - Call obproxy-ce-py_script_generate_config-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - import generate_config - add generate_config ref count to 1 Generate obproxy configuration ok - open /root/.obd/cluster/obclu/inner_config.yaml for w - mkdir /root/.obd/cluster/obclu - sub generate_config ref count to 0 - export generate_config - Call obagent-py_script_generate_config-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - import generate_config - add generate_config ref count to 1 Generate obagent configuration ok - sub generate_config ref count to 0 - export generate_config - Call prometheus-py_script_generate_config-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - import generate_config - add generate_config ref count to 1 Generate prometheus configuration ok - sub generate_config ref count to 0 - export generate_config - Call grafana-py_script_generate_config-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - import generate_config - add generate_config ref count to 1 Generate grafana configuration ok - sub generate_config ref count to 0 - export generate_config - open /root/.obd/cluster/obclu/inner_config.yaml for w - Get Deploy by name - exclusive lock `/root/.obd/lock/deploy_obclu`, count 3 - Get deploy info - judge deploy status - config path is None or not - Get deploy configuration - Search best suitable repository - Search package for components... - Get oceanbase-ce repository - Search repository oceanbase-ce version: None, tag: None, release: None, package_hash: None - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - share lock `/root/.obd/lock/mirror_and_repo`, count 16 - Search oceanbase-ce package from mirror - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 16 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 17 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 18 - md5 is None - name is oceanbase-ce - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: oceanbase-ce version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: 1d56dc742f5f05a2d15797d291b51a94019e728d - get RPM package by name: oceanbase-ce version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: 1d56dc742f5f05a2d15797d291b51a94019e728d - Found Package oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - name: oceanbase-ce version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: 1d56dc742f5f05a2d15797d291b51a94019e728d as same as oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d, Use package name: oceanbase-ce version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: 1d56dc742f5f05a2d15797d291b51a94019e728d - Get obproxy-ce repository - Search repository obproxy-ce version: None, tag: None, release: None, package_hash: None - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - share lock `/root/.obd/lock/mirror_and_repo`, count 17 - Search obproxy-ce package from mirror - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 19 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 20 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 21 - md5 is None - name is obproxy-ce - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: obproxy-ce version: 4.0.0 release:5.el7 arch: x86_64 md5: de53232a951184fad75b15884458d85e31d2f6c3 - get RPM package by name: obproxy-ce version: 4.0.0 release:5.el7 arch: x86_64 md5: de53232a951184fad75b15884458d85e31d2f6c3 - Found Package obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - name: obproxy-ce version: 4.0.0 release:5.el7 arch: x86_64 md5: de53232a951184fad75b15884458d85e31d2f6c3 as same as obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3, Use package name: obproxy-ce version: 4.0.0 release:5.el7 arch: x86_64 md5: de53232a951184fad75b15884458d85e31d2f6c3 - Get obagent repository - Search repository obagent version: None, tag: None, release: None, package_hash: None - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - share lock `/root/.obd/lock/mirror_and_repo`, count 18 - Search obagent package from mirror - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 22 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 23 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 24 - md5 is None - name is obagent - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: obagent version: 1.2.0 release:4.el7 arch: x86_64 md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e - get RPM package by name: obagent version: 1.2.0 release:4.el7 arch: x86_64 md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Found Package obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - name: obagent version: 1.2.0 release:4.el7 arch: x86_64 md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e as same as obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e, Use package name: obagent version: 1.2.0 release:4.el7 arch: x86_64 md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Get prometheus repository - Search repository prometheus version: None, tag: None, release: None, package_hash: None - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - share lock `/root/.obd/lock/mirror_and_repo`, count 19 - Search prometheus package from mirror - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 25 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 26 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 27 - md5 is None - name is prometheus - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: prometheus version: 2.37.1 release:10000102022110211.el7 arch: x86_64 md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 - get RPM package by name: prometheus version: 2.37.1 release:10000102022110211.el7 arch: x86_64 md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 - Found Package prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - name: prometheus version: 2.37.1 release:10000102022110211.el7 arch: x86_64 md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 as same as prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263, Use package name: prometheus version: 2.37.1 release:10000102022110211.el7 arch: x86_64 md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 - Get grafana repository - Search repository grafana version: None, tag: None, release: None, package_hash: None - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - share lock `/root/.obd/lock/mirror_and_repo`, count 20 - Search grafana package from mirror - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 28 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 29 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 30 - md5 is None - name is grafana - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: grafana version: 7.5.17 release:1 arch: x86_64 md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - get RPM package by name: grafana version: 7.5.17 release:1 arch: x86_64 md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Found Package grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - name: grafana version: 7.5.17 release:1 arch: x86_64 md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 as same as grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, Use package name: grafana version: 7.5.17 release:1 arch: x86_64 md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Searching install plugin for components ... - Searching install plugin for components ... - Search install plugin for oceanbase-ce - Found for oceanbase-ce-install-4.0.0.0 for oceanbase-ce-4.0.0.0 - Search install plugin for obproxy-ce - Found for obproxy-ce-install-3.1.0 for obproxy-ce-4.0.0 - Search install plugin for obagent - Found for obagent-install-0.1 for obagent-1.2.0 - Search install plugin for prometheus - Found for prometheus-install-2.37.1 for prometheus-2.37.1 - Search install plugin for grafana - Found for grafana-install-7.5.17 for grafana-7.5.17 install oceanbase-ce-4.0.0.0 for local ok - get head repository - Search repository oceanbase-ce version: 4.0.0.0, tag: oceanbase-ce, release: None, package_hash: None - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - share lock `/root/.obd/lock/mirror_and_repo`, count 21 - head repository: oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d install obproxy-ce-4.0.0 for local ok - get head repository - Search repository obproxy-ce version: 4.0.0, tag: obproxy-ce, release: None, package_hash: None - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - share lock `/root/.obd/lock/mirror_and_repo`, count 22 - head repository: obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 install obagent-1.2.0 for local ok - get head repository - Search repository obagent version: 1.2.0, tag: obagent, release: None, package_hash: None - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - share lock `/root/.obd/lock/mirror_and_repo`, count 23 - head repository: obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e install prometheus-2.37.1 for local ok - get head repository - Search repository prometheus version: 2.37.1, tag: prometheus, release: None, package_hash: None - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - share lock `/root/.obd/lock/mirror_and_repo`, count 24 - head repository: prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 install grafana-7.5.17 for local ok - get head repository - Search repository grafana version: 7.5.17, tag: grafana, release: None, package_hash: None - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - share lock `/root/.obd/lock/mirror_and_repo`, count 25 - head repository: grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Searching install plugin for components ... - Search install plugin for oceanbase-ce - Found for oceanbase-ce-install-4.0.0.0 for oceanbase-ce-4.0.0.0 - Search install plugin for obproxy-ce - Found for obproxy-ce-install-3.1.0 for obproxy-ce-4.0.0 - Search install plugin for obagent - Found for obagent-install-0.1 for obagent-1.2.0 - Search install plugin for prometheus - Found for prometheus-install-2.37.1 for prometheus-2.37.1 - Search install plugin for grafana - Found for grafana-install-7.5.17 for grafana-7.5.17 +--------------------------------------------------------------------------------------------+ | Packages | +--------------+---------+------------------------+------------------------------------------+ | Repository | Version | Release | Md5 | +--------------+---------+------------------------+------------------------------------------+ | oceanbase-ce | 4.0.0.0 | 103000022023011215.el7 | 1d56dc742f5f05a2d15797d291b51a94019e728d | | obproxy-ce | 4.0.0 | 5.el7 | de53232a951184fad75b15884458d85e31d2f6c3 | | obagent | 1.2.0 | 4.el7 | 0e8f5ee68c337ea28514c9f3f820ea546227fa7e | | prometheus | 2.37.1 | 10000102022110211.el7 | 58913c7606f05feb01bc1c6410346e5fc31cf263 | | grafana | 7.5.17 | 1 | 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 | +--------------+---------+------------------------+------------------------------------------+ Repository integrity check ok Parameter check ok - Searching param plugin for components ... - Search param plugin for oceanbase-ce - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Search param plugin for obproxy-ce - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Search param plugin for obagent - Found for obagent-param-1.1.0 for obagent-1.2.0 - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Search param plugin for prometheus - Found for prometheus-param-2.37.1 for prometheus-2.37.1 - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Search param plugin for grafana - Found for grafana-param-7.5.17 for grafana-7.5.17 - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Cluster param configuration check - server203(10.2.12.203) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check - server111(10.2.12.111) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check - server209(10.2.14.209) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check - 10.2.12.203 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 param check - host203(10.2.12.203) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check - host111(10.2.12.111) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check - host209(10.2.14.209) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check - 10.2.12.111 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 param check - 10.2.14.209 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 param check Open ssh connection ok Cluster status check ok - Searching status plugin for components ... - Searching status plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0 - Searching status plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0 - Searching status plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Found for obagent-py_script_status-0.1 for obagent-1.2.0 - Searching status plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Found for prometheus-py_script_status-2.37.1 for prometheus-2.37.1 - Searching status plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Found for grafana-py_script_status-7.5.17 for grafana-7.5.17 - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - import status - add status ref count to 1 -- root@10.2.12.203 execute: cat /root/observer/run/observer.pid -- exited code 1, error output: cat: /root/observer/run/observer.pid: No such file or directory -- root@10.2.12.111 execute: cat /root/observer/run/observer.pid -- exited code 1, error output: cat: /root/observer/run/observer.pid: No such file or directory -- root@10.2.14.209 execute: cat /root/observer/run/observer.pid -- exited code 1, error output: cat: /root/observer/run/observer.pid: No such file or directory - sub status ref count to 0 - export status - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - import status - add status ref count to 1 -- root@10.2.12.203 execute: cat /root/obproxy/run/obproxy-10.2.12.203-2883.pid -- exited code 1, error output: cat: /root/obproxy/run/obproxy-10.2.12.203-2883.pid: No such file or directory - sub status ref count to 0 - export status - Call obagent-py_script_status-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - import status - add status ref count to 1 -- root@10.2.12.203 execute: cat /root/obagent/run/obagent-10.2.12.203-8088.pid -- exited code 1, error output: cat: /root/obagent/run/obagent-10.2.12.203-8088.pid: No such file or directory -- root@10.2.12.111 execute: cat /root/obagent/run/obagent-10.2.12.111-8088.pid -- exited code 1, error output: cat: /root/obagent/run/obagent-10.2.12.111-8088.pid: No such file or directory -- root@10.2.14.209 execute: cat /root/obagent/run/obagent-10.2.14.209-8088.pid -- exited code 1, error output: cat: /root/obagent/run/obagent-10.2.14.209-8088.pid: No such file or directory - sub status ref count to 0 - export status - Call prometheus-py_script_status-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - import status - add status ref count to 1 -- root@10.2.12.111 execute: cat /root/prometheus/run/prometheus.pid -- exited code 1, error output: cat: /root/prometheus/run/prometheus.pid: No such file or directory - sub status ref count to 0 - export status - Call grafana-py_script_status-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - import status - add status ref count to 1 -- root@10.2.14.209 execute: cat /root/grafana/run/grafana.pid -- exited code 1, error output: cat: /root/grafana/run/grafana.pid: No such file or directory - sub status ref count to 0 - export status - Search init plugin - Searching init plugin for components ... - Searching init plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Found for oceanbase-ce-py_script_init-4.0.0.0 for oceanbase-ce-4.0.0.0 - Searching init plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Found for obproxy-ce-py_script_init-3.1.0 for obproxy-ce-4.0.0 - Searching init plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Found for obagent-py_script_init-0.1 for obagent-1.2.0 - Searching init plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Found for prometheus-py_script_init-2.37.1 for prometheus-2.37.1 - Searching init plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Found for grafana-py_script_init-7.5.17 for grafana-7.5.17 - Exec oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d init plugin - Apply oceanbase-ce-py_script_init-4.0.0.0 for oceanbase-ce-4.0.0.0 - import init - add init ref count to 1 -- option `force` is None Initializes observer work home ok -- root@10.2.12.203 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- server203(10.2.12.203) initializes observer work home -- root@10.2.12.203 execute: mkdir -p /root/observer -- exited code 0 -- root@10.2.12.203 execute: ls /root/observer -- exited code 0 -- root@10.2.12.203 execute: bash -c "mkdir -p /root/observer/{etc,admin,.conf,log,bin,lib}" -- exited code 0 -- root@10.2.12.203 execute: mkdir -p /DATA/disk1/data -- exited code 0 -- root@10.2.12.203 execute: ls /DATA/disk1/data -- exited code 0 -- root@10.2.12.203 execute: bash -c "mkdir -p /DATA/disk1/data/sstable" -- exited code 0 -- root@10.2.12.203 execute: if [ ! '/DATA/disk1/data' -ef '/root/observer/store' ]; then ln -sf /DATA/disk1/data /root/observer/store; fi -- exited code 0 -- root@10.2.12.203 execute: mkdir -p /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.12.203 execute: ls /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.12.203 execute: mkdir -p /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.12.203 execute: if [ ! '/DATA/disk2/redo/clog' -ef '/DATA/disk1/data/clog' ]; then ln -sf /DATA/disk2/redo/clog /DATA/disk1/data/clog; fi -- exited code 0 -- root@10.2.12.203 execute: mkdir -p /DATA/disk1/data/slog -- exited code 0 -- root@10.2.12.203 execute: ls /DATA/disk1/data/slog -- exited code 0 -- root@10.2.12.203 execute: mkdir -p /DATA/disk1/data/slog -- exited code 0 -- root@10.2.12.203 execute: if [ ! '/DATA/disk1/data/slog' -ef '/DATA/disk1/data/slog' ]; then ln -sf /DATA/disk1/data/slog /DATA/disk1/data/slog; fi -- exited code 0 -- check slog dir in the same disk with data dir -- root@10.2.12.203 execute: df --block-size=1024 /DATA/disk1/data/slog | awk 'NR == 2 { print $1 }' -- exited code 0 -- slog disk is /dev/nvme0n1 -- root@10.2.12.203 execute: df --block-size=1024 /DATA/disk1/data | awk 'NR == 2 { print $1 }' -- exited code 0 -- data disk is /dev/nvme0n1 -- root@10.2.12.111 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- server111(10.2.12.111) initializes observer work home -- root@10.2.12.111 execute: mkdir -p /root/observer -- exited code 0 -- root@10.2.12.111 execute: ls /root/observer -- exited code 0 -- root@10.2.12.111 execute: bash -c "mkdir -p /root/observer/{etc,admin,.conf,log,bin,lib}" -- exited code 0 -- root@10.2.12.111 execute: mkdir -p /DATA/disk1/data -- exited code 0 -- root@10.2.12.111 execute: ls /DATA/disk1/data -- exited code 0 -- root@10.2.12.111 execute: bash -c "mkdir -p /DATA/disk1/data/sstable" -- exited code 0 -- root@10.2.12.111 execute: if [ ! '/DATA/disk1/data' -ef '/root/observer/store' ]; then ln -sf /DATA/disk1/data /root/observer/store; fi -- exited code 0 -- root@10.2.12.111 execute: mkdir -p /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.12.111 execute: ls /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.12.111 execute: mkdir -p /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.12.111 execute: if [ ! '/DATA/disk2/redo/clog' -ef '/DATA/disk1/data/clog' ]; then ln -sf /DATA/disk2/redo/clog /DATA/disk1/data/clog; fi -- exited code 0 -- root@10.2.12.111 execute: mkdir -p /DATA/disk1/data/slog -- exited code 0 -- root@10.2.12.111 execute: ls /DATA/disk1/data/slog -- exited code 0 -- root@10.2.12.111 execute: mkdir -p /DATA/disk1/data/slog -- exited code 0 -- root@10.2.12.111 execute: if [ ! '/DATA/disk1/data/slog' -ef '/DATA/disk1/data/slog' ]; then ln -sf /DATA/disk1/data/slog /DATA/disk1/data/slog; fi -- exited code 0 -- check slog dir in the same disk with data dir -- root@10.2.12.111 execute: df --block-size=1024 /DATA/disk1/data/slog | awk 'NR == 2 { print $1 }' -- exited code 0 -- slog disk is /dev/nvme0n1 -- root@10.2.12.111 execute: df --block-size=1024 /DATA/disk1/data | awk 'NR == 2 { print $1 }' -- exited code 0 -- data disk is /dev/nvme0n1 -- root@10.2.14.209 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- server209(10.2.14.209) initializes observer work home -- root@10.2.14.209 execute: mkdir -p /root/observer -- exited code 0 -- root@10.2.14.209 execute: ls /root/observer -- exited code 0 -- root@10.2.14.209 execute: bash -c "mkdir -p /root/observer/{etc,admin,.conf,log,bin,lib}" -- exited code 0 -- root@10.2.14.209 execute: mkdir -p /DATA/disk1/data -- exited code 0 -- root@10.2.14.209 execute: ls /DATA/disk1/data -- exited code 0 -- root@10.2.14.209 execute: bash -c "mkdir -p /DATA/disk1/data/sstable" -- exited code 0 -- root@10.2.14.209 execute: if [ ! '/DATA/disk1/data' -ef '/root/observer/store' ]; then ln -sf /DATA/disk1/data /root/observer/store; fi -- exited code 0 -- root@10.2.14.209 execute: mkdir -p /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.14.209 execute: ls /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.14.209 execute: mkdir -p /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.14.209 execute: if [ ! '/DATA/disk2/redo/clog' -ef '/DATA/disk1/data/clog' ]; then ln -sf /DATA/disk2/redo/clog /DATA/disk1/data/clog; fi -- exited code 0 -- root@10.2.14.209 execute: mkdir -p /DATA/disk1/data/slog -- exited code 0 -- root@10.2.14.209 execute: ls /DATA/disk1/data/slog -- exited code 0 -- root@10.2.14.209 execute: mkdir -p /DATA/disk1/data/slog -- exited code 0 -- root@10.2.14.209 execute: if [ ! '/DATA/disk1/data/slog' -ef '/DATA/disk1/data/slog' ]; then ln -sf /DATA/disk1/data/slog /DATA/disk1/data/slog; fi -- exited code 0 -- check slog dir in the same disk with data dir -- root@10.2.14.209 execute: df --block-size=1024 /DATA/disk1/data/slog | awk 'NR == 2 { print $1 }' -- exited code 0 -- slog disk is /dev/nvme0n1 -- root@10.2.14.209 execute: df --block-size=1024 /DATA/disk1/data | awk 'NR == 2 { print $1 }' -- exited code 0 -- data disk is /dev/nvme0n1 - sub init ref count to 0 - export init - Exec obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 init plugin - Apply obproxy-ce-py_script_init-3.1.0 for obproxy-ce-4.0.0 - import init - add init ref count to 1 Initializes obproxy work home ok -- root@10.2.12.203 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- 10.2.12.203 init cluster work home -- root@10.2.12.203 execute: bash -c 'mkdir -p /root/obproxy/{run,bin,lib}' -- exited code 0 - sub init ref count to 0 - export init - Exec obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e init plugin - Apply obagent-py_script_init-0.1 for obagent-1.2.0 - import init - add init ref count to 1 Initializes obagent work home ok -- root@10.2.12.203 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- host203(10.2.12.203) init cluster work home -- root@10.2.12.203 execute: mkdir -p /root/obagent -- exited code 0 -- root@10.2.12.203 execute: ls /root/obagent -- exited code 0 -- root@10.2.12.203 execute: bash -c 'mkdir -p /root/obagent/{run,bin,lib,conf,log}' -- exited code 0 -- root@10.2.12.111 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- host111(10.2.12.111) init cluster work home -- root@10.2.12.111 execute: mkdir -p /root/obagent -- exited code 0 -- root@10.2.12.111 execute: ls /root/obagent -- exited code 0 -- root@10.2.12.111 execute: bash -c 'mkdir -p /root/obagent/{run,bin,lib,conf,log}' -- exited code 0 -- root@10.2.14.209 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- host209(10.2.14.209) init cluster work home -- root@10.2.14.209 execute: mkdir -p /root/obagent -- exited code 0 -- root@10.2.14.209 execute: ls /root/obagent -- exited code 0 -- root@10.2.14.209 execute: bash -c 'mkdir -p /root/obagent/{run,bin,lib,conf,log}' -- exited code 0 - sub init ref count to 0 - export init - Exec prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 init plugin - Apply prometheus-py_script_init-2.37.1 for prometheus-2.37.1 - import init - add init ref count to 1 Initializes prometheus work home ok -- root@10.2.12.111 execute: mkdir -p /root/prometheus -- exited code 0 -- root@10.2.12.111 execute: ls /root/prometheus -- exited code 0 -- root@10.2.12.111 execute: mkdir -p /root/prometheus/data -- exited code 0 -- root@10.2.12.111 execute: ls /root/prometheus/data -- exited code 0 - sub init ref count to 0 - export init - Exec grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 init plugin - Apply grafana-py_script_init-7.5.17 for grafana-7.5.17 - import init - add init ref count to 1 Initializes grafana work home ok -- 10.2.14.209 init grafana work home -- root@10.2.14.209 execute: bash -c "mkdir -p /root/grafana/{run,conf}" -- exited code 0 -- root@10.2.14.209 execute: mkdir -p /root/grafana/data -- exited code 0 -- root@10.2.14.209 execute: ls /root/grafana/data -- exited code 0 -- root@10.2.14.209 execute: if [ ! '/root/grafana/data' -ef '/root/grafana/data' ]; then ln -sf /root/grafana/data /root/grafana/data; fi -- exited code 0 -- root@10.2.14.209 execute: mkdir -p /root/grafana/data/log -- exited code 0 -- root@10.2.14.209 execute: ls /root/grafana/data/log -- exited code 0 -- root@10.2.14.209 execute: if [ ! '/root/grafana/data/log' -ef '/root/grafana/data/log' ]; then ln -sf /root/grafana/data/log /root/grafana/data/log; fi -- exited code 0 -- root@10.2.14.209 execute: mkdir -p /root/grafana/data/plugins -- exited code 0 -- root@10.2.14.209 execute: ls /root/grafana/data/plugins -- exited code 0 -- root@10.2.14.209 execute: if [ ! '/root/grafana/data/plugins' -ef '/root/grafana/data/plugins' ]; then ln -sf /root/grafana/data/plugins /root/grafana/data/plugins; fi -- exited code 0 -- root@10.2.14.209 execute: mkdir -p /root/grafana/conf/provisioning -- exited code 0 -- root@10.2.14.209 execute: ls /root/grafana/conf/provisioning -- exited code 0 -- root@10.2.14.209 execute: if [ ! '/root/grafana/conf/provisioning' -ef '/root/grafana/conf/provisioning' ]; then ln -sf /root/grafana/conf/provisioning /root/grafana/conf/provisioning; fi -- exited code 0 -- root@10.2.14.209 execute: bash -c "mkdir -p /root/grafana/conf/provisioning/dashboards/templates" -- exited code 0 - local execute: rsync -h - exited code 0 - root@10.2.14.209 execute: rsync -h - exited code 0 - current remote_transporter RemoteTransporter.RSYNC -- root@10.2.14.209 execute: mkdir -p /root/grafana/conf/provisioning/dashboards/templates -- exited code 0 -- send /root/.obd/plugins/grafana/7.5.17/oceanbase-metrics_rev1.json to /root/grafana/conf/provisioning/dashboards/templates/oceanbase-metrics_rev1.json by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /root/.obd/plugins/grafana/7.5.17/oceanbase-metrics_rev1.json root@10.2.14.209:/root/grafana/conf/provisioning/dashboards/templates/oceanbase-metrics_rev1.json -- exited code 0 -- root@10.2.14.209 execute: ln -s /root/grafana/data/log /root/grafana/log -- exited code 0 - sub init ref count to 0 - export init - import install_repo - add install_repo ref count to 1 Remote oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository install ok -- Remote oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository integrity check -- server203(10.2.12.203) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository integrity check -- root@10.2.12.203 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.12.203 execute: cat /root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/.data -- exited code 0 -- server203(10.2.12.203) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d install check -- server203(10.2.12.203) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d has installed -- root@10.2.12.203 set env _repo_dir to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d' -- root@10.2.12.203 set env _home_path to '/root/observer' -- root@10.2.12.203 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin/observer' -- root@10.2.12.203 set env target to '/root/observer/bin/observer' -- root@10.2.12.203 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin' -- root@10.2.12.203 set env target to '/root/observer/bin' -- root@10.2.12.203 execute: ls -1 ${source} -- exited code 0 -- root@10.2.12.203 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.203 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/etc' -- root@10.2.12.203 set env target to '/root/observer/etc' -- root@10.2.12.203 execute: ls -1 ${source} -- exited code 0 -- root@10.2.12.203 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.203 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/admin' -- root@10.2.12.203 set env target to '/root/observer/admin' -- root@10.2.12.203 execute: ls -1 ${source} -- exited code 0 -- root@10.2.12.203 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.203 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- server111(10.2.12.111) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository integrity check -- root@10.2.12.111 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.12.111 execute: cat /root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/.data -- exited code 0 -- server111(10.2.12.111) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d install check -- server111(10.2.12.111) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d has installed -- root@10.2.12.111 set env _repo_dir to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d' -- root@10.2.12.111 set env _home_path to '/root/observer' -- root@10.2.12.111 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin/observer' -- root@10.2.12.111 set env target to '/root/observer/bin/observer' -- root@10.2.12.111 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin' -- root@10.2.12.111 set env target to '/root/observer/bin' -- root@10.2.12.111 execute: ls -1 ${source} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/etc' -- root@10.2.12.111 set env target to '/root/observer/etc' -- root@10.2.12.111 execute: ls -1 ${source} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/admin' -- root@10.2.12.111 set env target to '/root/observer/admin' -- root@10.2.12.111 execute: ls -1 ${source} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- server209(10.2.14.209) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository integrity check -- root@10.2.14.209 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.14.209 execute: cat /root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/.data -- exited code 0 -- server209(10.2.14.209) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d install check -- server209(10.2.14.209) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d has installed -- root@10.2.14.209 set env _repo_dir to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d' -- root@10.2.14.209 set env _home_path to '/root/observer' -- root@10.2.14.209 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin/observer' -- root@10.2.14.209 set env target to '/root/observer/bin/observer' -- root@10.2.14.209 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin' -- root@10.2.14.209 set env target to '/root/observer/bin' -- root@10.2.14.209 execute: ls -1 ${source} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/etc' -- root@10.2.14.209 set env target to '/root/observer/etc' -- root@10.2.14.209 execute: ls -1 ${source} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/admin' -- root@10.2.14.209 set env target to '/root/observer/admin' -- root@10.2.14.209 execute: ls -1 ${source} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 Remote oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check !! -- server203(10.2.12.203) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check -- root@10.2.12.203 set env LD_LIBRARY_PATH to '/root/observer/lib:' -- root@10.2.12.203 execute: ldd /root/observer/bin/observer -- exited code 0 -- root@10.2.12.203 set env LD_LIBRARY_PATH to '' -- server111(10.2.12.111) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check -- root@10.2.12.111 set env LD_LIBRARY_PATH to '/root/observer/lib:' -- root@10.2.12.111 execute: ldd /root/observer/bin/observer -- exited code 0 -- root@10.2.12.111 set env LD_LIBRARY_PATH to '' -- server209(10.2.14.209) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check -- root@10.2.14.209 set env LD_LIBRARY_PATH to '/root/observer/lib:' -- root@10.2.14.209 execute: ldd /root/observer/bin/observer -- exited code 0 -- root@10.2.14.209 set env LD_LIBRARY_PATH to '' - sub install_repo ref count to 0 - export install_repo Remote obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 repository install ok -- Remote obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 repository integrity check -- 10.2.12.203 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 repository integrity check -- root@10.2.12.203 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.12.203 execute: cat /root/.obd/repository/obproxy-ce/4.0.0/de53232a951184fad75b15884458d85e31d2f6c3/.data -- exited code 0 -- 10.2.12.203 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 install check -- 10.2.12.203 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 has installed -- root@10.2.12.203 set env _repo_dir to '/root/.obd/repository/obproxy-ce/4.0.0/de53232a951184fad75b15884458d85e31d2f6c3' -- root@10.2.12.203 set env _home_path to '/root/obproxy' -- root@10.2.12.203 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/obproxy-ce/4.0.0/de53232a951184fad75b15884458d85e31d2f6c3/bin/obproxy' -- root@10.2.12.203 set env target to '/root/obproxy/bin/obproxy' -- root@10.2.12.203 execute: ln -fs ${source} ${target} -- exited code 0 Remote obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 repository lib check ok -- 10.2.12.203 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 repository lib check -- root@10.2.12.203 set env LD_LIBRARY_PATH to '/root/obproxy/lib:' -- root@10.2.12.203 execute: ldd /root/obproxy/bin/obproxy -- exited code 0 -- root@10.2.12.203 set env LD_LIBRARY_PATH to '' Remote obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository install ok -- Remote obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository integrity check -- host203(10.2.12.203) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository integrity check -- root@10.2.12.203 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.12.203 execute: cat /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/.data -- exited code 0 -- host203(10.2.12.203) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e install check -- host203(10.2.12.203) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e has installed -- root@10.2.12.203 set env _repo_dir to '/root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e' -- root@10.2.12.203 set env _home_path to '/root/obagent' -- root@10.2.12.203 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/bin/monagent' -- root@10.2.12.203 set env target to '/root/obagent/bin/monagent' -- root@10.2.12.203 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf' -- root@10.2.12.203 set env target to '/root/obagent/conf' -- root@10.2.12.203 execute: ls -1 ${source} -- exited code 0 -- root@10.2.12.203 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.203 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- host111(10.2.12.111) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository integrity check -- root@10.2.12.111 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.12.111 execute: cat /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/.data -- exited code 0 -- host111(10.2.12.111) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e install check -- host111(10.2.12.111) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e has installed -- root@10.2.12.111 set env _repo_dir to '/root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e' -- root@10.2.12.111 set env _home_path to '/root/obagent' -- root@10.2.12.111 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/bin/monagent' -- root@10.2.12.111 set env target to '/root/obagent/bin/monagent' -- root@10.2.12.111 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf' -- root@10.2.12.111 set env target to '/root/obagent/conf' -- root@10.2.12.111 execute: ls -1 ${source} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- host209(10.2.14.209) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository integrity check -- root@10.2.14.209 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.14.209 execute: cat /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/.data -- exited code 0 -- host209(10.2.14.209) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e install check -- host209(10.2.14.209) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e has installed -- root@10.2.14.209 set env _repo_dir to '/root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e' -- root@10.2.14.209 set env _home_path to '/root/obagent' -- root@10.2.14.209 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/bin/monagent' -- root@10.2.14.209 set env target to '/root/obagent/bin/monagent' -- root@10.2.14.209 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf' -- root@10.2.14.209 set env target to '/root/obagent/conf' -- root@10.2.14.209 execute: ls -1 ${source} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 Remote obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository lib check ok -- host203(10.2.12.203) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository lib check -- root@10.2.12.203 set env LD_LIBRARY_PATH to '/root/obagent/lib:' -- root@10.2.12.203 execute: ldd /root/obagent/bin/monagent -- exited code 0 -- root@10.2.12.203 set env LD_LIBRARY_PATH to '' -- host111(10.2.12.111) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository lib check -- root@10.2.12.111 set env LD_LIBRARY_PATH to '/root/obagent/lib:' -- root@10.2.12.111 execute: ldd /root/obagent/bin/monagent -- exited code 0 -- root@10.2.12.111 set env LD_LIBRARY_PATH to '' -- host209(10.2.14.209) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository lib check -- root@10.2.14.209 set env LD_LIBRARY_PATH to '/root/obagent/lib:' -- root@10.2.14.209 execute: ldd /root/obagent/bin/monagent -- exited code 0 -- root@10.2.14.209 set env LD_LIBRARY_PATH to '' Remote prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository install ok -- Remote prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository integrity check -- 10.2.12.111 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository integrity check -- root@10.2.12.111 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.12.111 execute: cat /root/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263/.data -- exited code 0 -- 10.2.12.111 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 install check -- 10.2.12.111 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 has installed -- root@10.2.12.111 set env _repo_dir to '/root/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263' -- root@10.2.12.111 set env _home_path to '/root/prometheus' -- root@10.2.12.111 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263/prometheus' -- root@10.2.12.111 set env target to '/root/prometheus/prometheus' -- root@10.2.12.111 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263/promtool' -- root@10.2.12.111 set env target to '/root/prometheus/promtool' -- root@10.2.12.111 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263/consoles' -- root@10.2.12.111 set env target to '/root/prometheus/consoles' -- root@10.2.12.111 execute: ls -1 ${source} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263/console_libraries' -- root@10.2.12.111 set env target to '/root/prometheus/console_libraries' -- root@10.2.12.111 execute: ls -1 ${source} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.12.111 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 Remote prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository lib check ok -- 10.2.12.111 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository lib check -- root@10.2.12.111 set env LD_LIBRARY_PATH to '/root/prometheus/lib:' -- root@10.2.12.111 set env LD_LIBRARY_PATH to '' Remote grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository install ok -- Remote grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository integrity check -- 10.2.14.209 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository integrity check -- root@10.2.14.209 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.14.209 execute: cat /root/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/.data -- exited code 0 -- 10.2.14.209 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 install check -- 10.2.14.209 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 has installed -- root@10.2.14.209 set env _repo_dir to '/root/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6' -- root@10.2.14.209 set env _home_path to '/root/grafana' -- root@10.2.14.209 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/bin/grafana-server' -- root@10.2.14.209 set env target to '/root/grafana/bin/grafana-server' -- root@10.2.14.209 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/bin' -- root@10.2.14.209 set env target to '/root/grafana/bin' -- root@10.2.14.209 execute: ls -1 ${source} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/public' -- root@10.2.14.209 set env target to '/root/grafana/public' -- root@10.2.14.209 execute: ls -1 ${source} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/plugins-bundled' -- root@10.2.14.209 set env target to '/root/grafana/plugins-bundled' -- root@10.2.14.209 execute: ls -1 ${source} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/scripts' -- root@10.2.14.209 set env target to '/root/grafana/scripts' -- root@10.2.14.209 execute: ls -1 ${source} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/conf' -- root@10.2.14.209 set env target to '/root/grafana/conf' -- root@10.2.14.209 execute: ls -1 ${source} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 -- root@10.2.14.209 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} -- exited code 0 Remote grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository lib check ok -- 10.2.14.209 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository lib check -- root@10.2.14.209 set env LD_LIBRARY_PATH to '/root/grafana/lib:' -- root@10.2.14.209 execute: ldd /root/grafana/bin/grafana-server -- exited code 0 -- root@10.2.14.209 set env LD_LIBRARY_PATH to '' Try to get lib-repository - Search best suitable repository libs - Search package for components... - Get oceanbase-ce-libs repository - Search repository oceanbase-ce-libs version: None, tag: None, release: None, package_hash: None - share lock `/root/.obd/lock/mirror_and_repo`, count 26 - mkdir /root/.obd/repository/oceanbase-ce-libs - Found repository oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 - share lock `/root/.obd/lock/mirror_and_repo`, count 27 - Search oceanbase-ce-libs package from mirror - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 31 - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 32 - load repo config: /root/.obd/mirror/remote/OceanBase.repo - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 33 - md5 is None - name is oceanbase-ce-libs - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] - release is None - version is None - MirrorRepositoryType.LOCAL mirror local found pkg: name: oceanbase-ce-libs version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: ef48cff7633e3dbc39f5c0abdcd72348213e09a2 - get RPM package by name: oceanbase-ce-libs version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: ef48cff7633e3dbc39f5c0abdcd72348213e09a2 - Found Package oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 - name: oceanbase-ce-libs version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: ef48cff7633e3dbc39f5c0abdcd72348213e09a2 as same as oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2, Use package name: oceanbase-ce-libs version: 4.0.0.0 release:103000022023011215.el7 arch: x86_64 md5: ef48cff7633e3dbc39f5c0abdcd72348213e09a2 - Searching install plugin for components ... - Searching install plugin for components ... - Search install plugin for oceanbase-ce-libs - Found for oceanbase-ce-libs-install-3.1.0 for oceanbase-ce-libs-4.0.0.0 install oceanbase-ce-libs-4.0.0.0 for local ok - get head repository - Search repository oceanbase-ce-libs version: 4.0.0.0, tag: oceanbase-ce-libs, release: None, package_hash: None - Found repository oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 - share lock `/root/.obd/lock/mirror_and_repo`, count 28 - head repository: oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 Remote oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 repository install ok -- Remote oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 repository integrity check -- server203(10.2.12.203) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 repository integrity check -- root@10.2.12.203 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.12.203 execute: cat /root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/.data -- exited code 0 -- server203(10.2.12.203) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 install check -- server203(10.2.12.203) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 has installed -- root@10.2.12.203 set env _repo_dir to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2' -- root@10.2.12.203 set env _home_path to '/root/observer/lib' -- root@10.2.12.203 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so' -- root@10.2.12.203 set env target to '/root/observer/lib/libaio.so' -- root@10.2.12.203 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1' -- root@10.2.12.203 set env target to '/root/observer/lib/libaio.so.1' -- root@10.2.12.203 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1.0.1' -- root@10.2.12.203 set env target to '/root/observer/lib/libaio.so.1.0.1' -- root@10.2.12.203 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so' -- root@10.2.12.203 set env target to '/root/observer/lib/libmariadb.so' -- root@10.2.12.203 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.203 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so.3' -- root@10.2.12.203 set env target to '/root/observer/lib/libmariadb.so.3' -- root@10.2.12.203 execute: ln -fs ${source} ${target} -- exited code 0 -- server111(10.2.12.111) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 repository integrity check -- root@10.2.12.111 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.12.111 execute: cat /root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/.data -- exited code 0 -- server111(10.2.12.111) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 install check -- server111(10.2.12.111) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 has installed -- root@10.2.12.111 set env _repo_dir to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2' -- root@10.2.12.111 set env _home_path to '/root/observer/lib' -- root@10.2.12.111 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so' -- root@10.2.12.111 set env target to '/root/observer/lib/libaio.so' -- root@10.2.12.111 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1' -- root@10.2.12.111 set env target to '/root/observer/lib/libaio.so.1' -- root@10.2.12.111 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1.0.1' -- root@10.2.12.111 set env target to '/root/observer/lib/libaio.so.1.0.1' -- root@10.2.12.111 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so' -- root@10.2.12.111 set env target to '/root/observer/lib/libmariadb.so' -- root@10.2.12.111 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.12.111 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so.3' -- root@10.2.12.111 set env target to '/root/observer/lib/libmariadb.so.3' -- root@10.2.12.111 execute: ln -fs ${source} ${target} -- exited code 0 -- server209(10.2.14.209) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 repository integrity check -- root@10.2.14.209 execute: echo ${OBD_HOME:-"$HOME"}/.obd -- exited code 0 -- root@10.2.14.209 execute: cat /root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/.data -- exited code 0 -- server209(10.2.14.209) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 install check -- server209(10.2.14.209) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 has installed -- root@10.2.14.209 set env _repo_dir to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2' -- root@10.2.14.209 set env _home_path to '/root/observer/lib' -- root@10.2.14.209 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so' -- root@10.2.14.209 set env target to '/root/observer/lib/libaio.so' -- root@10.2.14.209 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1' -- root@10.2.14.209 set env target to '/root/observer/lib/libaio.so.1' -- root@10.2.14.209 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1.0.1' -- root@10.2.14.209 set env target to '/root/observer/lib/libaio.so.1.0.1' -- root@10.2.14.209 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so' -- root@10.2.14.209 set env target to '/root/observer/lib/libmariadb.so' -- root@10.2.14.209 execute: ln -fs ${source} ${target} -- exited code 0 -- root@10.2.14.209 set env source to '/root/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so.3' -- root@10.2.14.209 set env target to '/root/observer/lib/libmariadb.so.3' -- root@10.2.14.209 execute: ln -fs ${source} ${target} -- exited code 0 Remote oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check ok -- server203(10.2.12.203) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check -- root@10.2.12.203 set env LD_LIBRARY_PATH to '/root/observer/lib:' -- root@10.2.12.203 execute: ldd /root/observer/bin/observer -- exited code 0 -- root@10.2.12.203 set env LD_LIBRARY_PATH to '' -- server111(10.2.12.111) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check -- root@10.2.12.111 set env LD_LIBRARY_PATH to '/root/observer/lib:' -- root@10.2.12.111 execute: ldd /root/observer/bin/observer -- exited code 0 -- root@10.2.12.111 set env LD_LIBRARY_PATH to '' -- server209(10.2.14.209) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check -- root@10.2.14.209 set env LD_LIBRARY_PATH to '/root/observer/lib:' -- root@10.2.14.209 execute: ldd /root/observer/bin/observer -- exited code 0 -- root@10.2.14.209 set env LD_LIBRARY_PATH to '' - import rsync - add rsync ref count to 1 - sub rsync ref count to 0 - export rsync - dump deploy info to /root/.obd/cluster/obclu/.data - open /root/.obd/cluster/obclu/inner_config.yaml for w obclu deployed - Get Deploy by name - exclusive lock `/root/.obd/lock/deploy_obclu`, count 4 - Deploy status judge Get local repositories ok - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d - Search repository oceanbase-ce version: 4.0.0.0, tag: 1d56dc742f5f05a2d15797d291b51a94019e728d, release: None, package_hash: None - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 - Search repository obproxy-ce version: 4.0.0, tag: de53232a951184fad75b15884458d85e31d2f6c3, release: None, package_hash: None - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Search repository obagent version: 1.2.0, tag: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e, release: None, package_hash: None - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 - Search repository prometheus version: 2.37.1, tag: 58913c7606f05feb01bc1c6410346e5fc31cf263, release: None, package_hash: None - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Search repository grafana version: 7.5.17, tag: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, release: None, package_hash: None - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Get deploy config Search plugins ok - Searching start_check plugin for components ... - Searching start_check plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Found for oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0 - Searching start_check plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0 - Searching start_check plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Found for obagent-py_script_start_check-1.1.1 for obagent-1.2.0 - Searching start_check plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Found for prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1 - Searching start_check plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Found for grafana-py_script_start_check-7.5.17 for grafana-7.5.17 - Searching start plugin for components ... - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 - Searching connect plugin for components ... - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 - Searching bootstrap plugin for components ... - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 - Searching display plugin for components ... - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Found for obagent-py_script_display-0.1 for obagent-1.2.0 - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 Open ssh connection ok Load cluster param plugin ok - Searching param plugin for components ... - Search param plugin for oceanbase-ce - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - Search param plugin for obproxy-ce - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - Search param plugin for obagent - Found for obagent-param-1.1.0 for obagent-1.2.0 - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - Search param plugin for prometheus - Found for prometheus-param-2.37.1 for prometheus-2.37.1 - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - Search param plugin for grafana - Found for grafana-param-7.5.17 for grafana-7.5.17 - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - Call oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - import start_check - add start_check ref count to 1 Check before start observer ok -- root@10.2.12.203 execute: cat /root/observer/run/observer.pid -- exited code 1, error output: cat: /root/observer/run/observer.pid: No such file or directory -- server203(10.2.12.203) port check -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.12.203 execute: ls /DATA/disk1/data/sstable/block_file -- exited code 2, error output: ls: cannot access /DATA/disk1/data/sstable/block_file: No such file or directory -- root@10.2.12.203 execute: grep -e '^ *bond1:' /proc/net/dev -- exited code 0 -- root@10.2.12.111 execute: cat /root/observer/run/observer.pid -- exited code 1, error output: cat: /root/observer/run/observer.pid: No such file or directory -- server111(10.2.12.111) port check -- root@10.2.12.111 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.12.111 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.12.111 execute: ls /DATA/disk1/data/sstable/block_file -- exited code 2, error output: ls: cannot access /DATA/disk1/data/sstable/block_file: No such file or directory -- root@10.2.12.111 execute: grep -e '^ *bond1:' /proc/net/dev -- exited code 0 -- root@10.2.14.209 execute: cat /root/observer/run/observer.pid -- exited code 1, error output: cat: /root/observer/run/observer.pid: No such file or directory -- server209(10.2.14.209) port check -- root@10.2.14.209 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.14.209 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.14.209 execute: ls /DATA/disk1/data/sstable/block_file -- exited code 2, error output: ls: cannot access /DATA/disk1/data/sstable/block_file: No such file or directory -- root@10.2.14.209 execute: grep -e '^ *bond1:' /proc/net/dev -- exited code 0 -- root@10.2.12.203 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr -- exited code 0 -- root@10.2.12.203 execute: ulimit -a -- exited code 0 -- root@10.2.12.203 execute: cat /proc/meminfo -- exited code 0 -- root@10.2.12.203 execute: df --block-size=1024 -- exited code 0 -- root@10.2.12.203 execute: df --block-size=1024 /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.12.203 execute: df --block-size=1024 /DATA/disk1/data -- exited code 0 -- disk: {'/': {'total': 467867566080, 'avail': 440079908864, 'need': 0}, '/dev': {'total': 202055598080, 'avail': 202055598080, 'need': 0}, '/dev/shm': {'total': 202083274752, 'avail': 202083258368, 'need': 0}, '/run': {'total': 202083274752, 'avail': 202063781888, 'need': 0}, '/sys/fs/cgroup': {'total': 202083274752, 'avail': 202083274752, 'need': 0}, '/DATA/disk1': {'total': 3838880616448, 'avail': 3838846767104, 'need': 0}, '/DATA/disk2': {'total': 3838880616448, 'avail': 3838846799872, 'need': 0}, '/DATA/disk3': {'total': 3838880616448, 'avail': 3838846832640, 'need': 0}, '/DATA/disk4': {'total': 3838880616448, 'avail': 3838846832640, 'need': 0}, '/boot': {'total': 3961167872, 'avail': 3588202496, 'need': 0}, '/run/user/0': {'total': 40416657408, 'avail': 40416657408, 'need': 0}} -- root@10.2.12.111 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr -- exited code 0 -- root@10.2.12.111 execute: ulimit -a -- exited code 0 -- root@10.2.12.111 execute: cat /proc/meminfo -- exited code 0 -- root@10.2.12.111 execute: df --block-size=1024 -- exited code 0 -- root@10.2.12.111 execute: df --block-size=1024 /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.12.111 execute: df --block-size=1024 /DATA/disk1/data -- exited code 0 -- disk: {'/': {'total': 467867566080, 'avail': 440283287552, 'need': 0}, '/dev': {'total': 202024824832, 'avail': 202024824832, 'need': 0}, '/dev/shm': {'total': 202053246976, 'avail': 202053230592, 'need': 0}, '/run': {'total': 202053246976, 'avail': 202033459200, 'need': 0}, '/sys/fs/cgroup': {'total': 202053246976, 'avail': 202053246976, 'need': 0}, '/boot': {'total': 3961167872, 'avail': 3585601536, 'need': 0}, '/DATA/disk3': {'total': 3838880616448, 'avail': 3838846832640, 'need': 0}, '/DATA/disk2': {'total': 3838880616448, 'avail': 3838846799872, 'need': 0}, '/DATA/disk1': {'total': 3838880616448, 'avail': 3838846767104, 'need': 0}, '/DATA/disk4': {'total': 3838880616448, 'avail': 3838846832640, 'need': 0}, '/run/user/0': {'total': 40410652672, 'avail': 40410652672, 'need': 0}} -- root@10.2.14.209 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr -- exited code 0 -- root@10.2.14.209 execute: ulimit -a -- exited code 0 -- root@10.2.14.209 execute: cat /proc/meminfo -- exited code 0 -- root@10.2.14.209 execute: df --block-size=1024 -- exited code 0 -- root@10.2.14.209 execute: df --block-size=1024 /DATA/disk2/redo/clog -- exited code 0 -- root@10.2.14.209 execute: df --block-size=1024 /DATA/disk1/data -- exited code 0 -- disk: {'/': {'total': 467867566080, 'avail': 441254330368, 'need': 0}, '/dev': {'total': 202055593984, 'avail': 202055593984, 'need': 0}, '/dev/shm': {'total': 202083274752, 'avail': 202083258368, 'need': 0}, '/run': {'total': 202083274752, 'avail': 202063912960, 'need': 0}, '/sys/fs/cgroup': {'total': 202083274752, 'avail': 202083274752, 'need': 0}, '/boot': {'total': 3961167872, 'avail': 3588198400, 'need': 0}, '/DATA/disk4': {'total': 3838880616448, 'avail': 3838846832640, 'need': 0}, '/DATA/disk3': {'total': 3838880616448, 'avail': 3838846832640, 'need': 0}, '/DATA/disk1': {'total': 3838880616448, 'avail': 3838846767104, 'need': 0}, '/DATA/disk2': {'total': 3838880616448, 'avail': 3838846799872, 'need': 0}, '/run/user/0': {'total': 40416657408, 'avail': 40416657408, 'need': 0}} -- root@10.2.12.203 execute: ping -W 1 -c 1 -I bond1 10.2.12.111 -- exited code 0 -- root@10.2.12.203 execute: ping -W 1 -c 1 -I bond1 10.2.14.209 -- exited code 0 -- root@10.2.12.111 execute: ping -W 1 -c 1 -I bond1 10.2.12.203 -- exited code 0 -- root@10.2.12.111 execute: ping -W 1 -c 1 -I bond1 10.2.14.209 -- exited code 0 -- root@10.2.14.209 execute: ping -W 1 -c 1 -I bond1 10.2.12.203 -- exited code 0 -- root@10.2.14.209 execute: ping -W 1 -c 1 -I bond1 10.2.12.111 -- exited code 0 -- root@10.2.12.203 execute: date +%s%N -- exited code 0 -- 10.2.12.203 time delta -0.880859375 -- root@10.2.12.111 execute: date +%s%N -- exited code 0 -- 10.2.12.111 time delta -18.559326171875 -- root@10.2.14.209 execute: date +%s%N -- exited code 0 -- 10.2.14.209 time delta -10.2841796875 - sub start_check ref count to 0 - export start_check - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - import start_check - add start_check ref count to 1 Check before start obproxy ok -- root@10.2.12.203 execute: cat /root/obproxy/run/obproxy-10.2.12.203-2883.pid -- exited code 1, error output: cat: /root/obproxy/run/obproxy-10.2.12.203-2883.pid: No such file or directory -- 10.2.12.203 port check -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq -- exited code 0 - sub start_check ref count to 0 - export start_check - Call obagent-py_script_start_check-1.1.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - import start_check - add start_check ref count to 1 Check before start obagent ok -- root@10.2.12.203 execute: cat /root/obagent/run/obagent-10.2.12.203-8088.pid -- exited code 1, error output: cat: /root/obagent/run/obagent-10.2.12.203-8088.pid: No such file or directory -- host203(10.2.12.203) port check -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.12.111 execute: cat /root/obagent/run/obagent-10.2.12.111-8088.pid -- exited code 1, error output: cat: /root/obagent/run/obagent-10.2.12.111-8088.pid: No such file or directory -- host111(10.2.12.111) port check -- root@10.2.12.111 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.12.111 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.14.209 execute: cat /root/obagent/run/obagent-10.2.14.209-8088.pid -- exited code 1, error output: cat: /root/obagent/run/obagent-10.2.14.209-8088.pid: No such file or directory -- host209(10.2.14.209) port check -- root@10.2.14.209 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.14.209 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq -- exited code 0 - sub start_check ref count to 0 - export start_check - Call prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - import start_check - add start_check ref count to 1 Check before start prometheus ok -- root@10.2.12.111 execute: cat /root/prometheus/run/prometheus.pid -- exited code 1, error output: cat: /root/prometheus/run/prometheus.pid: No such file or directory -- 10.2.12.111 port check -- root@10.2.12.111 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq -- exited code 0 - sub start_check ref count to 0 - export start_check - Call grafana-py_script_start_check-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - import start_check - add start_check ref count to 1 Check before start grafana ok -- root@10.2.14.209 execute: cat /root/grafana/run/grafana.pid -- exited code 1, error output: cat: /root/grafana/run/grafana.pid: No such file or directory -- 10.2.14.209 port check -- root@10.2.14.209 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq -- exited code 0 - sub start_check ref count to 0 - export start_check - Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - import start - add start ref count to 1 Start observer ok -- root@10.2.12.203 execute: cat /root/observer/run/observer.pid -- exited code 1, error output: cat: /root/observer/run/observer.pid: No such file or directory -- server203(10.2.12.203) start command construction -- root@10.2.12.111 execute: cat /root/observer/run/observer.pid -- exited code 1, error output: cat: /root/observer/run/observer.pid: No such file or directory -- server111(10.2.12.111) start command construction -- root@10.2.14.209 execute: cat /root/observer/run/observer.pid -- exited code 1, error output: cat: /root/observer/run/observer.pid: No such file or directory -- server209(10.2.14.209) start command construction -- starting server203(10.2.12.203) observer -- root@10.2.12.203 set env LD_LIBRARY_PATH to '/root/observer/lib:' -- root@10.2.12.203 execute: cd /root/observer; /root/observer/bin/observer -r '10.2.12.203:2882:2881;10.2.12.111:2882:2881;10.2.14.209:2882:2881' -p 2881 -P 2882 -z 'zone1' -n 'obcluster' -c 1 -d '/DATA/disk1/data' -i 'bond1' -l 'INFO' -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=True,max_syslog_file_count=4,memory_limit='331G',system_memory='99G',cpu_count=70,datafile_size='993G',log_disk_size='993G' -- exited code 0 -- root@10.2.12.203 delete env LD_LIBRARY_PATH -- starting server111(10.2.12.111) observer -- root@10.2.12.111 set env LD_LIBRARY_PATH to '/root/observer/lib:' -- root@10.2.12.111 execute: cd /root/observer; /root/observer/bin/observer -r '10.2.12.203:2882:2881;10.2.12.111:2882:2881;10.2.14.209:2882:2881' -p 2881 -P 2882 -z 'zone2' -n 'obcluster' -c 1 -d '/DATA/disk1/data' -i 'bond1' -l 'INFO' -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=True,max_syslog_file_count=4,memory_limit='330G',system_memory='99G',cpu_count=70,datafile_size='991G',log_disk_size='991G' -- exited code 0 -- root@10.2.12.111 delete env LD_LIBRARY_PATH -- starting server209(10.2.14.209) observer -- root@10.2.14.209 set env LD_LIBRARY_PATH to '/root/observer/lib:' -- root@10.2.14.209 execute: cd /root/observer; /root/observer/bin/observer -r '10.2.12.203:2882:2881;10.2.12.111:2882:2881;10.2.14.209:2882:2881' -p 2881 -P 2882 -z 'zone3' -n 'obcluster' -c 1 -d '/DATA/disk1/data' -i 'bond1' -l 'INFO' -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=True,max_syslog_file_count=4,memory_limit='331G',system_memory='99G',cpu_count=70,datafile_size='994G',log_disk_size='994G' -- exited code 0 -- root@10.2.14.209 delete env LD_LIBRARY_PATH observer program health check ok -- server203(10.2.12.203) program health check -- root@10.2.12.203 execute: cat /root/observer/run/observer.pid -- exited code 0 -- root@10.2.12.203 execute: ls /proc/149093 -- exited code 0 -- server203(10.2.12.203) observer[pid: 149093] started -- server111(10.2.12.111) program health check -- root@10.2.12.111 execute: cat /root/observer/run/observer.pid -- exited code 0 -- root@10.2.12.111 execute: ls /proc/143520 -- exited code 0 -- server111(10.2.12.111) observer[pid: 143520] started -- server209(10.2.14.209) program health check -- root@10.2.14.209 execute: cat /root/observer/run/observer.pid -- exited code 0 -- root@10.2.14.209 execute: ls /proc/80298 -- exited code 0 -- server209(10.2.14.209) observer[pid: 80298] started - sub start ref count to 0 - export start - Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - import connect - add connect ref count to 1 Connect to observer ok -- connect 10.2.12.203 -P2881 -uroot -p - sub connect ref count to 0 - export connect Initialize cluster ok - Call oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - import bootstrap - add bootstrap ref count to 1 -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' -- 4012:Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. -- execute sql: alter system bootstrap REGION "sys_region" ZONE "zone1" SERVER "10.2.12.203:2882",REGION "sys_region" ZONE "zone2" SERVER "10.2.12.111:2882",REGION "sys_region" ZONE "zone3" SERVER "10.2.14.209:2882" -- create user "proxyro" IDENTIFIED BY %s -- grant select on oceanbase.* to proxyro IDENTIFIED BY %s - sub bootstrap ref count to 0 - export bootstrap - Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - import start - add start ref count to 1 Start obproxy ok -- root@10.2.12.203 execute: ls /root/obproxy/etc/obproxy_config.bin -- exited code 2, error output: ls: cannot access /root/obproxy/etc/obproxy_config.bin: No such file or directory -- 10.2.12.203 port check -- root@10.2.12.203 execute: cat /root/obproxy/run/obproxy-10.2.12.203-2883.pid -- exited code 1, error output: cat: /root/obproxy/run/obproxy-10.2.12.203-2883.pid: No such file or directory -- starting 10.2.12.203 obproxy -- root@10.2.12.203 set env LD_LIBRARY_PATH to '/root/obproxy/lib:' -- root@10.2.12.203 execute: cd /root/obproxy; /root/obproxy/bin/obproxy -o obproxy_sys_password='',enable_strict_kernel_release=False,enable_cluster_checkout=False,skip_proxy_sys_private_check=True --listen_port 2883 --prometheus_listen_port 2884 --rs_list '10.2.12.203:2881;10.2.12.111:2881;10.2.14.209:2881' --cluster_name 'obcluster' -- exited code 0 -- root@10.2.12.203 delete env LD_LIBRARY_PATH -- root@10.2.12.203 execute: ps -aux | grep -e '/root/obproxy/bin/obproxy -o obproxy_sys_password=,enable_strict_kernel_release=False,enable_cluster_checkout=False,skip_proxy_sys_private_check=True --listen_port 2883 --prometheus_listen_port 2884 --rs_list 10.2.12.203:2881;10.2.12.111:2881;10.2.14.209:2881 --cluster_name obcluster$' | grep -v grep | awk '{print $2}' > /root/obproxy/run/obproxy-10.2.12.203-2883.pid -- exited code 0 obproxy program health check ok -- 10.2.12.203 program health check -- root@10.2.12.203 execute: cat /root/obproxy/run/obproxy-10.2.12.203-2883.pid -- exited code 0 -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- failed to start 10.2.12.203 obproxy, remaining retries: 19 -- 10.2.12.203 program health check -- root@10.2.12.203 execute: cat /root/obproxy/run/obproxy-10.2.12.203-2883.pid -- exited code 0 -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- 1180197 -- root@10.2.12.203 execute: ls -l /proc/149698/fd/ |grep -E 'socket:\[(1180197)\]' -- exited code 0 -- root@10.2.12.203 execute: pid=`cat /root/obproxy/run/obproxyd-10.2.12.203-2883.pid` && ls /proc/$pid -- exited code 1, error output: cat: /root/obproxy/run/obproxyd-10.2.12.203-2883.pid: No such file or directory -- root@10.2.12.203 execute: echo 149698 > /root/obproxy/run/obproxy-10.2.12.203-2883.pid -- exited code 0 - local execute: rsync -h - exited code 0 - root@10.2.12.203 execute: rsync -h - exited code 0 - current remote_transporter RemoteTransporter.RSYNC -- root@10.2.12.203 execute: mkdir -p /root/obproxy -- exited code 0 -- send /root/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /root/obproxy/obproxyd.sh by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /root/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh root@10.2.12.203:/root/obproxy/obproxyd.sh -- exited code 0 -- root@10.2.12.203 execute: bash /root/obproxy/obproxyd.sh /root/obproxy 10.2.12.203 2883 -- exited code 0 -- 10.2.12.203 program health check -- root@10.2.12.203 execute: cat /root/obproxy/run/obproxy-10.2.12.203-2883.pid -- exited code 0 -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- failed to start 10.2.12.203 obproxy, remaining retries: 17 -- 10.2.12.203 program health check -- root@10.2.12.203 execute: cat /root/obproxy/run/obproxy-10.2.12.203-2883.pid -- exited code 0 -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- 1199367 -- root@10.2.12.203 execute: ls -l /proc/149932/fd/ |grep -E 'socket:\[(1199367)\]' -- exited code 0 -- root@10.2.12.203 execute: pid=`cat /root/obproxy/run/obproxyd-10.2.12.203-2883.pid` && ls /proc/$pid -- exited code 0 -- 10.2.12.203 obproxy[pid: 149932] started - sub start ref count to 0 - export start - Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - import connect - add connect ref count to 1 Connect to obproxy ok -- connect 10.2.12.203 -P2883 -uroot@proxysys -p - sub connect ref count to 0 - export connect Initialize cluster ok - Call obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - import bootstrap - add bootstrap ref count to 1 -- execute sql: alter proxyconfig set observer_sys_password = -- execute sql: alter proxyconfig set obproxy_sys_password = - sub bootstrap ref count to 0 - export bootstrap - Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - import start - add start ref count to 1 Start obagent ok -- root@10.2.12.203 execute: cat /root/obagent/run/obagent-10.2.12.203-8088.pid -- exited code 1, error output: cat: /root/obagent/run/obagent-10.2.12.203-8088.pid: No such file or directory -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml - local execute: rsync -h - exited code 0 - root@10.2.12.203 execute: rsync -h - exited code 0 - current remote_transporter RemoteTransporter.RSYNC -- root@10.2.12.203 execute: mkdir -p /root/obagent/conf/config_properties -- exited code 0 -- send /tmp/tmpu7wckyh0.yaml to /root/obagent/conf/config_properties/monagent_basic_auth.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpu7wckyh0.yaml root@10.2.12.203:/root/obagent/conf/config_properties/monagent_basic_auth.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml -- root@10.2.12.203 execute: mkdir -p /root/obagent/conf/config_properties -- exited code 0 -- send /tmp/tmpcph3i1tk.yaml to /root/obagent/conf/config_properties/monagent_pipeline.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpcph3i1tk.yaml root@10.2.12.203:/root/obagent/conf/config_properties/monagent_pipeline.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml -- root@10.2.12.203 execute: mkdir -p /root/obagent/conf/prometheus_config -- exited code 0 -- send /tmp/tmpb6zxowyk.yaml to /root/obagent/conf/prometheus_config/prometheus.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpb6zxowyk.yaml root@10.2.12.203:/root/obagent/conf/prometheus_config/prometheus.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml -- root@10.2.12.203 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpv1bj7l6e.yaml to /root/obagent/conf/module_config/monitor_ob_log.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpv1bj7l6e.yaml root@10.2.12.203:/root/obagent/conf/module_config/monitor_ob_log.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml -- root@10.2.12.203 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpxm31dv7l.yaml to /root/obagent/conf/module_config/monagent_basic_auth.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpxm31dv7l.yaml root@10.2.12.203:/root/obagent/conf/module_config/monagent_basic_auth.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml -- root@10.2.12.203 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmp3m0g2o14.yaml to /root/obagent/conf/module_config/monitor_ob.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmp3m0g2o14.yaml root@10.2.12.203:/root/obagent/conf/module_config/monitor_ob.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml -- root@10.2.12.203 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpumc6l8d_.yaml to /root/obagent/conf/module_config/monagent_config.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpumc6l8d_.yaml root@10.2.12.203:/root/obagent/conf/module_config/monagent_config.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml -- root@10.2.12.203 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmp4s_yee8v.yaml to /root/obagent/conf/module_config/monitor_node_host.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmp4s_yee8v.yaml root@10.2.12.203:/root/obagent/conf/module_config/monitor_node_host.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml -- root@10.2.12.203 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpeh7gbdv6.yaml to /root/obagent/conf/module_config/monitor_mysql.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpeh7gbdv6.yaml root@10.2.12.203:/root/obagent/conf/module_config/monitor_mysql.yaml -- exited code 0 -- root@10.2.12.203 execute: mkdir -p /root/obagent/conf -- exited code 0 -- send /tmp/tmppyc80evq.yaml to /root/obagent/conf/monagent.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmppyc80evq.yaml root@10.2.12.203:/root/obagent/conf/monagent.yaml -- exited code 0 -- root@10.2.12.203 execute: cd /root/obagent;nohup /root/obagent/bin/monagent -c conf/monagent.yaml >> /root/obagent/log/monagent_stdout.log 2>&1 & echo $! > /root/obagent/run/obagent-10.2.12.203-8088.pid -- exited code 0 -- root@10.2.12.111 execute: cat /root/obagent/run/obagent-10.2.12.111-8088.pid -- exited code 1, error output: cat: /root/obagent/run/obagent-10.2.12.111-8088.pid: No such file or directory -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml - local execute: rsync -h - exited code 0 - root@10.2.12.111 execute: rsync -h - exited code 0 - current remote_transporter RemoteTransporter.RSYNC -- root@10.2.12.111 execute: mkdir -p /root/obagent/conf/config_properties -- exited code 0 -- send /tmp/tmp1zr1qnhv.yaml to /root/obagent/conf/config_properties/monagent_basic_auth.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmp1zr1qnhv.yaml root@10.2.12.111:/root/obagent/conf/config_properties/monagent_basic_auth.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml -- root@10.2.12.111 execute: mkdir -p /root/obagent/conf/config_properties -- exited code 0 -- send /tmp/tmp0_4wcb0p.yaml to /root/obagent/conf/config_properties/monagent_pipeline.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmp0_4wcb0p.yaml root@10.2.12.111:/root/obagent/conf/config_properties/monagent_pipeline.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml -- root@10.2.12.111 execute: mkdir -p /root/obagent/conf/prometheus_config -- exited code 0 -- send /tmp/tmpyhqfm_pd.yaml to /root/obagent/conf/prometheus_config/prometheus.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpyhqfm_pd.yaml root@10.2.12.111:/root/obagent/conf/prometheus_config/prometheus.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml -- root@10.2.12.111 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpleppzrqd.yaml to /root/obagent/conf/module_config/monitor_ob_log.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpleppzrqd.yaml root@10.2.12.111:/root/obagent/conf/module_config/monitor_ob_log.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml -- root@10.2.12.111 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpb7acsrdx.yaml to /root/obagent/conf/module_config/monagent_basic_auth.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpb7acsrdx.yaml root@10.2.12.111:/root/obagent/conf/module_config/monagent_basic_auth.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml -- root@10.2.12.111 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpaoky4poy.yaml to /root/obagent/conf/module_config/monitor_ob.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpaoky4poy.yaml root@10.2.12.111:/root/obagent/conf/module_config/monitor_ob.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml -- root@10.2.12.111 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpz6uase9r.yaml to /root/obagent/conf/module_config/monagent_config.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpz6uase9r.yaml root@10.2.12.111:/root/obagent/conf/module_config/monagent_config.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml -- root@10.2.12.111 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpfobf4ndo.yaml to /root/obagent/conf/module_config/monitor_node_host.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpfobf4ndo.yaml root@10.2.12.111:/root/obagent/conf/module_config/monitor_node_host.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml -- root@10.2.12.111 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpykfldwve.yaml to /root/obagent/conf/module_config/monitor_mysql.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpykfldwve.yaml root@10.2.12.111:/root/obagent/conf/module_config/monitor_mysql.yaml -- exited code 0 -- root@10.2.12.111 execute: mkdir -p /root/obagent/conf -- exited code 0 -- send /tmp/tmph_r335tm.yaml to /root/obagent/conf/monagent.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmph_r335tm.yaml root@10.2.12.111:/root/obagent/conf/monagent.yaml -- exited code 0 -- root@10.2.12.111 execute: cd /root/obagent;nohup /root/obagent/bin/monagent -c conf/monagent.yaml >> /root/obagent/log/monagent_stdout.log 2>&1 & echo $! > /root/obagent/run/obagent-10.2.12.111-8088.pid -- exited code 0 -- root@10.2.14.209 execute: cat /root/obagent/run/obagent-10.2.14.209-8088.pid -- exited code 1, error output: cat: /root/obagent/run/obagent-10.2.14.209-8088.pid: No such file or directory -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml - local execute: rsync -h - exited code 0 - root@10.2.14.209 execute: rsync -h - exited code 0 - current remote_transporter RemoteTransporter.RSYNC -- root@10.2.14.209 execute: mkdir -p /root/obagent/conf/config_properties -- exited code 0 -- send /tmp/tmpgsvh_irw.yaml to /root/obagent/conf/config_properties/monagent_basic_auth.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpgsvh_irw.yaml root@10.2.14.209:/root/obagent/conf/config_properties/monagent_basic_auth.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml -- root@10.2.14.209 execute: mkdir -p /root/obagent/conf/config_properties -- exited code 0 -- send /tmp/tmp9tf6moo8.yaml to /root/obagent/conf/config_properties/monagent_pipeline.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmp9tf6moo8.yaml root@10.2.14.209:/root/obagent/conf/config_properties/monagent_pipeline.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml -- root@10.2.14.209 execute: mkdir -p /root/obagent/conf/prometheus_config -- exited code 0 -- send /tmp/tmpnueyd0r2.yaml to /root/obagent/conf/prometheus_config/prometheus.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpnueyd0r2.yaml root@10.2.14.209:/root/obagent/conf/prometheus_config/prometheus.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml -- root@10.2.14.209 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpv7lzrxdm.yaml to /root/obagent/conf/module_config/monitor_ob_log.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpv7lzrxdm.yaml root@10.2.14.209:/root/obagent/conf/module_config/monitor_ob_log.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml -- root@10.2.14.209 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmp0k34eeaf.yaml to /root/obagent/conf/module_config/monagent_basic_auth.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmp0k34eeaf.yaml root@10.2.14.209:/root/obagent/conf/module_config/monagent_basic_auth.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml -- root@10.2.14.209 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmp4xklfkxt.yaml to /root/obagent/conf/module_config/monitor_ob.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmp4xklfkxt.yaml root@10.2.14.209:/root/obagent/conf/module_config/monitor_ob.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml -- root@10.2.14.209 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpr00acp9o.yaml to /root/obagent/conf/module_config/monagent_config.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpr00acp9o.yaml root@10.2.14.209:/root/obagent/conf/module_config/monagent_config.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml -- root@10.2.14.209 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmplgh4d1o2.yaml to /root/obagent/conf/module_config/monitor_node_host.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmplgh4d1o2.yaml root@10.2.14.209:/root/obagent/conf/module_config/monitor_node_host.yaml -- exited code 0 -- format /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml -- root@10.2.14.209 execute: mkdir -p /root/obagent/conf/module_config -- exited code 0 -- send /tmp/tmpdzhbs7js.yaml to /root/obagent/conf/module_config/monitor_mysql.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpdzhbs7js.yaml root@10.2.14.209:/root/obagent/conf/module_config/monitor_mysql.yaml -- exited code 0 -- root@10.2.14.209 execute: mkdir -p /root/obagent/conf -- exited code 0 -- send /tmp/tmpxn_4i8vj.yaml to /root/obagent/conf/monagent.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpxn_4i8vj.yaml root@10.2.14.209:/root/obagent/conf/monagent.yaml -- exited code 0 -- root@10.2.14.209 execute: cd /root/obagent;nohup /root/obagent/bin/monagent -c conf/monagent.yaml >> /root/obagent/log/monagent_stdout.log 2>&1 & echo $! > /root/obagent/run/obagent-10.2.14.209-8088.pid -- exited code 0 obagent program health check ok -- host203(10.2.12.203) program health check -- root@10.2.12.203 execute: cat /root/obagent/run/obagent-10.2.12.203-8088.pid -- exited code 0 -- root@10.2.12.203 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- host111(10.2.12.111) program health check -- root@10.2.12.111 execute: cat /root/obagent/run/obagent-10.2.12.111-8088.pid -- exited code 0 -- root@10.2.12.111 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- host209(10.2.14.209) program health check -- root@10.2.14.209 execute: cat /root/obagent/run/obagent-10.2.14.209-8088.pid -- exited code 0 -- root@10.2.14.209 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- start to sync target config - sub start ref count to 0 - export start - Call obagent-py_script_connect-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - import connect - add connect ref count to 1 - sub connect ref count to 0 - export connect - Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - import start - add start ref count to 1 Start promethues ok -- root@10.2.12.111 execute: ls /root/prometheus/.prometheus_started -- exited code 2, error output: ls: cannot access /root/prometheus/.prometheus_started: No such file or directory -- root@10.2.12.111 execute: ls /root/prometheus/prometheus.yaml -- exited code 2, error output: ls: cannot access /root/prometheus/prometheus.yaml: No such file or directory -- load config from obagent -- open /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml for r -- root@10.2.12.111 execute: mkdir -p /root/prometheus/rules -- exited code 0 - local execute: rsync -h - exited code 0 - root@10.2.12.111 execute: rsync -h - exited code 0 - current remote_transporter RemoteTransporter.RSYNC -- send /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/rules to /root/prometheus/rules by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /root/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/rules/* root@10.2.12.111:/root/prometheus/rules -- exited code 0 -- write global: scrape_interval: 1s evaluation_interval: 10s rule_files: - rules/*rules.yaml scrape_configs: - job_name: prometheus metrics_path: /metrics scheme: http static_configs: - targets: - 10.2.12.111:9090 - job_name: node basic_auth: username: admin password: root metrics_path: /metrics/node/host scheme: http static_configs: - targets: - 10.2.12.203:8088 - 10.2.12.111:8088 - 10.2.14.209:8088 file_sd_configs: - files: - targets/*.yaml - job_name: ob_basic basic_auth: username: admin password: root metrics_path: /metrics/ob/basic scheme: http static_configs: - targets: - 10.2.12.203:8088 - 10.2.12.111:8088 - 10.2.14.209:8088 file_sd_configs: - files: - targets/*.yaml - job_name: ob_extra basic_auth: username: admin password: root metrics_path: /metrics/ob/extra scheme: http static_configs: - targets: - 10.2.12.203:8088 - 10.2.12.111:8088 - 10.2.14.209:8088 file_sd_configs: - files: - targets/*.yaml - job_name: agent basic_auth: username: admin password: root metrics_path: /metrics/stat scheme: http static_configs: - targets: - 10.2.12.203:8088 - 10.2.12.111:8088 - 10.2.14.209:8088 file_sd_configs: - files: - targets/*.yaml to root@10.2.12.111:22: /root/prometheus/prometheus.yaml -- root@10.2.12.111 execute: mkdir -p /root/prometheus -- exited code 0 -- send /tmp/tmphjuj4eo5 to /root/prometheus/prometheus.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmphjuj4eo5 root@10.2.12.111:/root/prometheus/prometheus.yaml -- exited code 0 -- root@10.2.12.111 execute: mkdir -p /root/prometheus -- exited code 0 -- send /root/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /root/prometheus/prometheusd.sh by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /root/.obd/plugins/prometheus/2.37.1/prometheusd.sh root@10.2.12.111:/root/prometheus/prometheusd.sh -- exited code 0 -- root@10.2.12.111 execute: cd /root/prometheus && bash prometheusd.sh --config.file=/root/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/root/prometheus/data --web.enable-lifecycle --start-only -- exited code 0 -- root@10.2.12.111 execute: pid=`cat /root/prometheus/run/prometheus.pid` && ls /proc/$pid -- exited code 0 prometheus program health check ok -- 10.2.12.111 program health check -- root@10.2.12.111 execute: cat /root/prometheus/run/prometheus.pid -- exited code 0 -- root@10.2.12.111 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- 947686 -- root@10.2.12.111 execute: ls -l /proc/144534/fd/ |grep -E 'socket:\[(947686)\]' -- exited code 0 -- root@10.2.12.111 execute: pid=`cat /root/prometheus/run/prometheusd.pid` && ls /proc/$pid -- exited code 1, error output: cat: /root/prometheus/run/prometheusd.pid: No such file or directory -- root@10.2.12.111 execute: mkdir -p /root/prometheus -- exited code 0 -- send /root/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /root/prometheus/prometheusd.sh by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /root/.obd/plugins/prometheus/2.37.1/prometheusd.sh root@10.2.12.111:/root/prometheus/prometheusd.sh -- exited code 0 -- root@10.2.12.111 execute: cd /root/prometheus && bash prometheusd.sh --config.file=/root/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/root/prometheus/data --web.enable-lifecycle -- exited code 0 -- 10.2.12.111 program health check -- root@10.2.12.111 execute: cat /root/prometheus/run/prometheus.pid -- exited code 0 -- root@10.2.12.111 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- 1106950 -- root@10.2.12.111 execute: ls -l /proc/144534/fd/ |grep -E 'socket:\[(1106950)\]' -- exited code 1, error output: ls: cannot access /proc/144534/fd/: No such file or directory -- failed to start 10.2.12.111 prometheus, remaining retries: 18 -- 10.2.12.111 program health check -- root@10.2.12.111 execute: cat /root/prometheus/run/prometheus.pid -- exited code 0 -- root@10.2.12.111 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- 1106950 -- root@10.2.12.111 execute: ls -l /proc/144679/fd/ |grep -E 'socket:\[(1106950)\]' -- exited code 0 -- root@10.2.12.111 execute: pid=`cat /root/prometheus/run/prometheusd.pid` && ls /proc/$pid -- exited code 0 -- 10.2.12.111 prometheusd[pid: 144679] started - sub start ref count to 0 - export start - Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - import connect - add connect ref count to 1 Connect to Prometheus ok -- connect prometheus (10.2.12.111:9090 by user None) -- send http request method: GET, url: http://10.2.12.111:9090/-/healthy, data: None - sub connect ref count to 0 - export connect Initialize cluster ok - Call prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - import bootstrap - add bootstrap ref count to 1 -- root@10.2.12.111 execute: touch /root/prometheus/.prometheus_started -- exited code 0 - sub bootstrap ref count to 0 - export bootstrap - Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - import start - add start ref count to 1 Start grafana ok -- 10.2.14.209 generate obd-grafana ini file - local execute: rsync -h - exited code 0 - root@10.2.14.209 execute: rsync -h - exited code 0 - current remote_transporter RemoteTransporter.RSYNC -- root@10.2.14.209 execute: mkdir -p /root/grafana/conf -- exited code 0 -- send /tmp/tmpehir45_t.ini to /root/grafana/conf/obd-grafana.ini by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpehir45_t.ini root@10.2.14.209:/root/grafana/conf/obd-grafana.ini -- exited code 0 -- 10.2.14.209 generate datasources yaml -- write apiVersion: 1 datasources: - name: OB-Prometheus isDefault: 'true' type: prometheus access: proxy editable: 'true' url: http://10.2.12.111:9090 to root@10.2.14.209:22: /root/grafana/conf/provisioning/datasources/sample.yaml -- root@10.2.14.209 execute: mkdir -p /root/grafana/conf/provisioning/datasources -- exited code 0 -- send /tmp/tmp6fpz7g72 to /root/grafana/conf/provisioning/datasources/sample.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmp6fpz7g72 root@10.2.14.209:/root/grafana/conf/provisioning/datasources/sample.yaml -- exited code 0 -- 10.2.14.209 generate providers yaml -- write apiVersion: 1 providers: - name: OceanBase Metrics type: file allowUiUpdates: 'true' options: path: /root/grafana/conf/provisioning/dashboards/templates to root@10.2.14.209:22: /root/grafana/conf/provisioning/dashboards/sample.yaml -- root@10.2.14.209 execute: mkdir -p /root/grafana/conf/provisioning/dashboards -- exited code 0 -- send /tmp/tmpll7gybz7 to /root/grafana/conf/provisioning/dashboards/sample.yaml by rsync -- local execute: rsync -a -W -e "ssh -i /root/kingcloud -p 22" /tmp/tmpll7gybz7 root@10.2.14.209:/root/grafana/conf/provisioning/dashboards/sample.yaml -- exited code 0 -- root@10.2.14.209 execute: ps -aux | grep -e '/root/grafana/bin/grafana-server --homepath=/root/grafana --config=/root/grafana/conf/obd-grafana.ini --pidfile=/root/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' -- exited code 0 -- root@10.2.14.209 execute: cd /root/grafana; bash -c '/root/grafana/bin/grafana-server --homepath=/root/grafana --config=/root/grafana/conf/obd-grafana.ini --pidfile=/root/grafana/run/grafana.pid > /root/grafana/data/log/grafana-console.log 2>&1 &' -- exited code 0 -- root@10.2.14.209 execute: ps -aux | grep -e '/root/grafana/bin/grafana-server --homepath=/root/grafana --config=/root/grafana/conf/obd-grafana.ini --pidfile=/root/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' -- exited code 0 grafana program health check ok -- 10.2.14.209 program health check -- servers_pid: {<_deploy.ServerConfig object at 0x7fe620db4438>: ['81208']} -- root@10.2.14.209 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq -- exited code 0 -- root@10.2.14.209 execute: ls -l /proc/81208/fd/ |grep -E 'socket:\[(903002)\]' -- exited code 0 -- root@10.2.14.209 execute: cat /root/grafana/run/grafana.pid -- exited code 0 -- 10.2.14.209 grafana[pid: 81208] started - sub start ref count to 0 - export start - Call grafana-py_script_connect-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - import connect - add connect ref count to 1 Connect to grafana ok -- root@10.2.14.209 execute: ls /root/grafana/run/.grafana -- exited code 2, error output: ls: cannot access /root/grafana/run/.grafana: No such file or directory -- connect grafana (10.2.14.209:3000 by user admin) - sub connect ref count to 0 - export connect Initialize cluster ok - Call grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - import bootstrap - add bootstrap ref count to 1 -- 10.2.14.209 grafana admin user password set -- root@10.2.14.209 execute: ls /root/grafana/run/.grafana -- exited code 2, error output: ls: cannot access /root/grafana/run/.grafana: No such file or directory -- send http request method: PUT, url: http://10.2.14.209:3000/api/user/password, data: {'oldPassword': 'admin', 'newPassword': 'oceanbase', 'confirmNew': 'oceanbase'} -- 10.2.14.209 grafana admin password set ok -- root@10.2.14.209 execute: touch /root/grafana/run/.grafana -- exited code 0 - sub bootstrap ref count to 0 - export bootstrap - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d - import display - add display ref count to 1 Wait for observer init ok +-----------------------------------------------+ | observer | +-------------+---------+------+-------+--------+ | ip | version | port | zone | status | +-------------+---------+------+-------+--------+ | 10.2.12.111 | 4.0.0.0 | 2881 | zone2 | ACTIVE | | 10.2.12.203 | 4.0.0.0 | 2881 | zone1 | ACTIVE | | 10.2.14.209 | 4.0.0.0 | 2881 | zone3 | ACTIVE | +-------------+---------+------+-------+--------+ obclient -h10.2.12.111 -P2881 -uroot -Doceanbase -A - sub display ref count to 0 - export display - Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 - import display - add display ref count to 1 +-----------------------------------------------+ | obproxy | +-------------+------+-----------------+--------+ | ip | port | prometheus_port | status | +-------------+------+-----------------+--------+ | 10.2.12.203 | 2883 | 2884 | active | +-------------+------+-----------------+--------+ obclient -h10.2.12.203 -P2883 -uroot -Doceanbase -A - sub display ref count to 0 - export display - Call obagent-py_script_display-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e - import display - add display ref count to 1 -- root@10.2.12.203 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.2.12.203:8088/metrics/stat" -- exited code 0 -- root@10.2.12.111 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.2.12.111:8088/metrics/stat" -- exited code 0 -- root@10.2.14.209 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.2.14.209:8088/metrics/stat" -- exited code 0 +-------------------------------------------------+ | obagent | +-------------+-------------+------------+--------+ | ip | server_port | pprof_port | status | +-------------+-------------+------------+--------+ | 10.2.12.203 | 8088 | 8089 | active | | 10.2.12.111 | 8088 | 8089 | active | | 10.2.14.209 | 8088 | 8089 | active | +-------------+-------------+------------+--------+ - sub display ref count to 0 - export display - Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 - import display - add display ref count to 1 -- send http request method: GET, url: http://10.2.12.111:9090/-/healthy, data: None +----------------------------------------------------+ | prometheus | +-------------------------+------+----------+--------+ | url | user | password | status | +-------------------------+------+----------+--------+ | http://10.2.12.111:9090 | | | active | +-------------------------+------+----------+--------+ - sub display ref count to 0 - export display - Call grafana-py_script_display-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 - import display - add display ref count to 1 -- type: -- send http request method: GET, url: http://10.2.14.209:3000/api/dashboards/tags, data: None +------------------------------------------------------------------+ | grafana | +-------------------------------------+-------+-----------+--------+ | url | user | password | status | +-------------------------------------+-------+-----------+--------+ | http://10.2.14.209:3000/d/oceanbase | admin | oceanbase | active | +-------------------------------------+-------+-----------+--------+ - sub display ref count to 0 - export display - Set obclu deploy status to running - dump deploy info to /root/.obd/cluster/obclu/.data obclu running - exclusive lock /root/.obd/lock/deploy_obclu release, count 3 - share lock /root/.obd/lock/mirror_and_repo release, count 27 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 32 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 31 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 30 - share lock /root/.obd/lock/mirror_and_repo release, count 26 - share lock /root/.obd/lock/mirror_and_repo release, count 25 - share lock /root/.obd/lock/mirror_and_repo release, count 24 - share lock /root/.obd/lock/mirror_and_repo release, count 23 - share lock /root/.obd/lock/mirror_and_repo release, count 22 - share lock /root/.obd/lock/mirror_and_repo release, count 21 - share lock /root/.obd/lock/mirror_and_repo release, count 20 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 29 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 28 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 27 - share lock /root/.obd/lock/mirror_and_repo release, count 19 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 26 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 25 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 24 - share lock /root/.obd/lock/mirror_and_repo release, count 18 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 23 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 22 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 21 - share lock /root/.obd/lock/mirror_and_repo release, count 17 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 20 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 19 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 18 - share lock /root/.obd/lock/mirror_and_repo release, count 16 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 17 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 16 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 15 - share lock /root/.obd/lock/mirror_and_repo release, count 15 - exclusive lock /root/.obd/lock/deploy_obclu release, count 2 - share lock /root/.obd/lock/mirror_and_repo release, count 14 - share lock /root/.obd/lock/mirror_and_repo release, count 13 - share lock /root/.obd/lock/mirror_and_repo release, count 12 - share lock /root/.obd/lock/mirror_and_repo release, count 11 - share lock /root/.obd/lock/mirror_and_repo release, count 10 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 14 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 13 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 12 - share lock /root/.obd/lock/mirror_and_repo release, count 9 - share lock /root/.obd/lock/mirror_and_repo release, count 8 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 11 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 10 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 9 - share lock /root/.obd/lock/mirror_and_repo release, count 7 - share lock /root/.obd/lock/mirror_and_repo release, count 6 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 8 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 7 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 6 - share lock /root/.obd/lock/mirror_and_repo release, count 5 - share lock /root/.obd/lock/mirror_and_repo release, count 4 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 5 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 4 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 3 - share lock /root/.obd/lock/mirror_and_repo release, count 3 - share lock /root/.obd/lock/mirror_and_repo release, count 2 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 2 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 1 - exclusive lock /root/.obd/lock/mirror_and_repo release, count 0 - try to get share lock /root/.obd/lock/mirror_and_repo - share lock /root/.obd/lock/mirror_and_repo release, count 1 - share lock /root/.obd/lock/mirror_and_repo release, count 0 - unlock /root/.obd/lock/mirror_and_repo - exclusive lock /root/.obd/lock/deploy_obclu release, count 1 - exclusive lock /root/.obd/lock/deploy_obclu release, count 0 - unlock /root/.obd/lock/deploy_obclu - share lock /root/.obd/lock/global release, count 0 - unlock /root/.obd/lock/global