[2023-02-21 09:42:22.352] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 09:42:22.353] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 09:42:22.353] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 09:42:22.353] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 09:42:22.353] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None} [2023-02-21 09:42:22.353] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 09:42:22.353] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 09:42:22.353] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 09:42:22.354] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 09:42:22.354] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 09:42:22.364] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Check the deploy status [2023-02-21 09:42:22.365] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 09:42:22.366] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 09:42:22.366] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:22.366] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 09:42:22.366] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 09:42:22.369] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:22.369] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 09:42:22.372] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:22.372] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 09:42:22.374] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:22.375] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 09:42:22.377] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:22.377] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 09:42:22.497] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 09:42:22.541] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [INFO] Search plugins [2023-02-21 09:42:22.541] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 09:42:22.541] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 09:42:22.541] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 09:42:22.542] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 09:42:22.542] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:23.219] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 09:42:23.220] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 09:42:23.220] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:23.392] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 09:42:23.392] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 09:42:23.393] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:23.492] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 09:42:23.492] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 09:42:23.492] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:23.514] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 09:42:23.514] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 09:42:23.514] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:23.547] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Searching stop plugin for components ... [2023-02-21 09:42:23.547] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:23.548] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 09:42:23.548] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:23.548] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 09:42:23.548] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Searching stop plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:23.548] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_stop-0.1 for obagent-1.2.0 [2023-02-21 09:42:23.548] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Searching stop plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:23.549] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_stop-2.37.1 for prometheus-2.37.1 [2023-02-21 09:42:23.549] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Searching stop plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:23.549] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_stop-7.5.17 for grafana-7.5.17 [2023-02-21 09:42:23.573] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 09:42:24.499] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:24.499] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 09:42:24.501] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 09:42:24.501] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [INFO] Stop observer [2023-02-21 09:42:24.503] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:24.537] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:24.537] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ps uax | egrep " 3742 " | grep -v grep [2023-02-21 09:42:24.642] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:24.642] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid:3742] stopping ... [2023-02-21 09:42:24.642] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: kill -9 3742 [2023-02-21 09:42:24.706] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:24.707] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:24.741] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:24.741] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ps uax | egrep " 175645 " | grep -v grep [2023-02-21 09:42:24.843] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:24.843] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid:175645] stopping ... [2023-02-21 09:42:24.843] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: kill -9 175645 [2023-02-21 09:42:24.942] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:24.943] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:24.974] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:24.974] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ps uax | egrep " 69836 " | grep -v grep [2023-02-21 09:42:25.077] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:25.077] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid:69836] stopping ... [2023-02-21 09:42:25.078] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: kill -9 69836 [2023-02-21 09:42:25.147] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.148] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) check whether the port is released [2023-02-21 09:42:26.149] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:26.174] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.175] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:26.241] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.242] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 09:42:26.304] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.304] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer is stopped [2023-02-21 09:42:26.305] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) check whether the port is released [2023-02-21 09:42:26.305] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:26.330] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.330] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:26.394] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.395] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 09:42:26.455] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.455] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer is stopped [2023-02-21 09:42:26.456] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) check whether the port is released [2023-02-21 09:42:26.456] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:26.496] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.496] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:26.572] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.572] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 09:42:26.639] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.639] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer is stopped [2023-02-21 09:42:26.718] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 09:42:26.719] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 09:42:26.719] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:26.719] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 09:42:26.720] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 09:42:26.721] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [INFO] Stop obproxy [2023-02-21 09:42:26.721] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:42:26.742] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.743] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/146032 [2023-02-21 09:42:26.803] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.803] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/146032/fd [2023-02-21 09:42:26.864] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:26.865] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid:146032] stopping ... [2023-02-21 09:42:26.865] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid | xargs kill -9; kill -9 -146032 [2023-02-21 09:42:26.926] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:27.928] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 09:42:27.928] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:27.953] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:27.953] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:28.019] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:28.019] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -f /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:42:28.078] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:28.079] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy is stopped [2023-02-21 09:42:28.156] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 09:42:28.156] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 09:42:28.156] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Call obagent-py_script_stop-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:28.156] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 09:42:28.157] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 09:42:28.158] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [INFO] Stop obagent [2023-02-21 09:42:28.159] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 09:42:28.191] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:28.192] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/4611 [2023-02-21 09:42:28.258] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:28.258] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent[pid:4611] stopping ... [2023-02-21 09:42:28.258] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: kill -9 4611 [2023-02-21 09:42:28.317] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:28.318] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 09:42:28.340] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:28.340] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/176476 [2023-02-21 09:42:28.402] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:28.402] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent[pid:176476] stopping ... [2023-02-21 09:42:28.402] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: kill -9 176476 [2023-02-21 09:42:28.460] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:28.460] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 09:42:28.488] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:28.488] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/70694 [2023-02-21 09:42:28.555] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:28.556] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent[pid:70694] stopping ... [2023-02-21 09:42:28.556] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: kill -9 70694 [2023-02-21 09:42:28.620] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:29.622] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) check whether the port is released [2023-02-21 09:42:29.622] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:29.656] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:29.656] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:29.727] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:29.728] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 09:42:29.790] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:29.791] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent is stopped [2023-02-21 09:42:29.791] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) check whether the port is released [2023-02-21 09:42:29.791] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:29.821] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:29.822] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:29.886] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:29.886] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 09:42:29.948] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:29.949] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent is stopped [2023-02-21 09:42:29.949] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) check whether the port is released [2023-02-21 09:42:29.949] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:29.985] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:29.985] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:30.053] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:30.053] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 09:42:30.118] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:30.118] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent is stopped [2023-02-21 09:42:30.246] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 09:42:30.246] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 09:42:30.246] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_stop-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:30.246] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 09:42:30.247] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 09:42:30.248] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [INFO] Stop prometheus [2023-02-21 09:42:30.248] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 09:42:30.269] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:30.269] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/146453 [2023-02-21 09:42:30.328] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:30.328] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/146453/fd [2023-02-21 09:42:30.386] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:30.386] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus[pid:146453] stopping... [2023-02-21 09:42:30.386] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheusd.pid | xargs kill -9; kill -9 146453 [2023-02-21 09:42:30.445] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:31.446] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 09:42:31.447] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:31.469] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:31.470] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -f /data/obdata/prometheus/run/prometheus.pid [2023-02-21 09:42:31.529] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:31.529] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus is stopped [2023-02-21 09:42:31.553] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 09:42:31.553] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 09:42:31.553] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Call grafana-py_script_stop-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:31.553] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 09:42:31.554] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 09:42:31.555] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [INFO] Stop grafana [2023-02-21 09:42:31.555] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 09:42:31.589] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:31.589] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/146668 [2023-02-21 09:42:31.651] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:31.651] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/146668/fd [2023-02-21 09:42:31.712] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:31.713] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana[pid:146668] stopping... [2023-02-21 09:42:31.713] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: kill -9 146668 [2023-02-21 09:42:31.772] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:32.774] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 09:42:32.774] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:32.802] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:32.803] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana is stopped [2023-02-21 09:42:32.859] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 09:42:32.859] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 09:42:32.859] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - Set observer deploy status to stopped [2023-02-21 09:42:32.859] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 09:42:32.866] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [INFO] observer stopped [2023-02-21 09:42:32.866] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 09:42:32.866] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 09:42:32.867] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 09:42:32.867] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 09:42:32.867] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 09:42:32.867] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 09:42:32.867] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 09:42:32.867] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 09:42:32.867] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 09:42:32.867] [fc375c96-b188-11ed-9feb-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 09:42:39.163] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 09:42:39.164] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 09:42:39.164] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 09:42:39.164] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 09:42:39.164] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2023-02-21 09:42:39.164] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 09:42:39.165] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 09:42:39.165] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 09:42:39.165] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 09:42:39.165] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 09:42:39.179] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 09:42:39.180] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 09:42:39.180] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 09:42:39.181] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:39.181] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: 4.0.0.0, tag: 1d56dc742f5f05a2d15797d291b51a94019e728d, release: None, package_hash: None [2023-02-21 09:42:39.181] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 09:42:39.181] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 09:42:39.181] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2023-02-21 09:42:39.184] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:39.184] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:39.185] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: de53232a951184fad75b15884458d85e31d2f6c3, release: None, package_hash: None [2023-02-21 09:42:39.185] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 09:42:39.185] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2023-02-21 09:42:39.187] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:39.187] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:39.187] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Search repository obagent version: 1.2.0, tag: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e, release: None, package_hash: None [2023-02-21 09:42:39.187] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 09:42:39.187] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obagent [2023-02-21 09:42:39.190] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:39.190] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:39.190] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Search repository prometheus version: 2.37.1, tag: 58913c7606f05feb01bc1c6410346e5fc31cf263, release: None, package_hash: None [2023-02-21 09:42:39.190] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 09:42:39.190] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/prometheus [2023-02-21 09:42:39.192] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:39.193] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:39.193] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Search repository grafana version: 7.5.17, tag: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, release: None, package_hash: None [2023-02-21 09:42:39.193] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 09:42:39.193] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/grafana [2023-02-21 09:42:39.195] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:39.312] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 09:42:39.360] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Search plugins [2023-02-21 09:42:39.361] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start_check plugin for components ... [2023-02-21 09:42:39.361] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:39.362] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 09:42:39.363] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 09:42:39.363] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:39.363] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 09:42:39.363] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:39.363] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start_check-1.1.1 for obagent-1.2.0 [2023-02-21 09:42:39.363] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start_check plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:39.364] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1 [2023-02-21 09:42:39.364] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start_check plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:39.364] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start_check-7.5.17 for grafana-7.5.17 [2023-02-21 09:42:39.364] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 09:42:39.364] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:39.364] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 09:42:39.365] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:39.365] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 09:42:39.365] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:39.365] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 09:42:39.365] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:39.365] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 09:42:39.366] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:39.366] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 09:42:39.366] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 09:42:39.366] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:39.367] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 09:42:39.367] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:39.367] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 09:42:39.367] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:39.367] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 09:42:39.367] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:39.367] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 09:42:39.368] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:39.368] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 09:42:39.368] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 09:42:39.368] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:39.369] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 09:42:39.369] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:39.369] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 09:42:39.369] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:39.369] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 09:42:39.369] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:39.369] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 09:42:39.370] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:39.370] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 09:42:39.370] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 09:42:39.370] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:39.370] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 09:42:39.370] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:39.371] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 09:42:39.371] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:39.371] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 09:42:39.371] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:39.371] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 09:42:39.371] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:39.372] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 09:42:39.492] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 09:42:40.414] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 09:42:40.414] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 09:42:40.414] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 09:42:40.415] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 09:42:40.415] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:41.115] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 09:42:41.115] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 09:42:41.115] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:41.284] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 09:42:41.285] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 09:42:41.285] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:41.387] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 09:42:41.387] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 09:42:41.387] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:41.409] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 09:42:41.410] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 09:42:41.410] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:41.463] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:41.463] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 09:42:41.470] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 09:42:41.470] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Check before start observer [2023-02-21 09:42:41.471] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:41.506] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:41.506] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 09:42:41.506] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:41.506] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) port check [2023-02-21 09:42:41.506] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:41.577] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:41.578] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:41.645] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:41.646] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /topevery/obdata/sstable/block_file [2023-02-21 09:42:41.709] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:41.710] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:41.743] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:41.743] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 09:42:41.743] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:41.744] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) port check [2023-02-21 09:42:41.744] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:41.809] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:41.810] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:41.871] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:41.872] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /data/obdata/sstable/block_file [2023-02-21 09:42:41.932] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:41.933] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:41.958] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:41.958] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 09:42:41.958] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:41.958] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) port check [2023-02-21 09:42:41.958] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:42.034] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.034] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:42.110] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.110] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /data/obdata/sstable/block_file [2023-02-21 09:42:42.186] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.186] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 09:42:42.208] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.209] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ulimit -a [2023-02-21 09:42:42.269] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.270] [063caa20-b189-11ed-ac32-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.65) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 09:42:42.270] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/meminfo [2023-02-21 09:42:42.330] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.331] [063caa20-b189-11ed-ac32-fa163e9e21e4] [WARNING] [WARN] OBD-2000: (10.253.208.65) not enough memory. (Free: 5.4G, Need: 10.0G) [2023-02-21 09:42:42.331] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: df --block-size=1024 [2023-02-21 09:42:42.397] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.398] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 51118542848, 'need': 0}, '/dev': {'total': 20979048448, 'avail': 20979048448, 'need': 0}, '/dev/shm': {'total': 20991266816, 'avail': 20991266816, 'need': 0}, '/run': {'total': 20991266816, 'avail': 20006989824, 'need': 0}, '/sys/fs/cgroup': {'total': 20991266816, 'avail': 20991266816, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 889667584, 'need': 0}, '/home': {'total': 44127686656, 'avail': 42842640384, 'need': 0}, '/topevery': {'total': 2113643364352, 'avail': 660663656448, 'need': 0}, '/run/user/0': {'total': 4198256640, 'avail': 4198256640, 'need': 0}, '/run/user/1001': {'total': 4198256640, 'avail': 4198256640, 'need': 0}} [2023-02-21 09:42:42.399] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 09:42:42.419] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.420] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ulimit -a [2023-02-21 09:42:42.479] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.479] [063caa20-b189-11ed-ac32-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.67) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 09:42:42.479] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/meminfo [2023-02-21 09:42:42.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: df --block-size=1024 [2023-02-21 09:42:42.610] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.610] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 50947358720, 'need': 0}, '/dev': {'total': 8296525824, 'avail': 8296525824, 'need': 0}, '/dev/shm': {'total': 8308740096, 'avail': 8308736000, 'need': 0}, '/run': {'total': 8308740096, 'avail': 7425191936, 'need': 0}, '/sys/fs/cgroup': {'total': 8308740096, 'avail': 8308740096, 'need': 0}, '/data': {'total': 211242950656, 'avail': 60835860480, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 889667584, 'need': 0}, '/home': {'total': 44127686656, 'avail': 42835030016, 'need': 0}, '/run/user/0': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1001': {'total': 1661751296, 'avail': 1661751296, 'need': 0}} [2023-02-21 09:42:42.610] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 09:42:42.633] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.634] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ulimit -a [2023-02-21 09:42:42.695] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.695] [063caa20-b189-11ed-ac32-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.172) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 09:42:42.695] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/meminfo [2023-02-21 09:42:42.757] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.757] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: df --block-size=1024 [2023-02-21 09:42:42.818] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.818] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 41952464896, 'need': 0}, '/dev': {'total': 8291450880, 'avail': 8291450880, 'need': 0}, '/dev/shm': {'total': 8308744192, 'avail': 8308715520, 'need': 0}, '/run': {'total': 8308744192, 'avail': 8079097856, 'need': 0}, '/sys/fs/cgroup': {'total': 8308744192, 'avail': 8308744192, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 844517376, 'need': 0}, '/home': {'total': 48420556800, 'avail': 47110725632, 'need': 0}, '/data': {'total': 316924559360, 'avail': 161144827904, 'need': 0}, '/run/user/0': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1002': {'total': 1661751296, 'avail': 1661751296, 'need': 0}} [2023-02-21 09:42:42.818] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: date +%s%N [2023-02-21 09:42:42.840] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.840] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.65 time delta -1.671630859375 [2023-02-21 09:42:42.841] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: date +%s%N [2023-02-21 09:42:42.862] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.862] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.67 time delta -1.77880859375 [2023-02-21 09:42:42.862] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: date +%s%N [2023-02-21 09:42:42.885] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.885] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.172 time delta -1.78173828125 [2023-02-21 09:42:42.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.65) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 09:42:42.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] [WARN] OBD-2000: (10.253.208.65) not enough memory. (Free: 5.4G, Need: 10.0G) [2023-02-21 09:42:42.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.67) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 09:42:42.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.172) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 09:42:42.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] [2023-02-21 09:42:42.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 09:42:42.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 09:42:42.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:42:42.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 09:42:42.908] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 09:42:42.908] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Check before start obproxy [2023-02-21 09:42:42.909] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:42:42.929] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:42.929] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 09:42:42.930] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:42.930] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 09:42:42.930] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:42.992] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:42.992] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:43.054] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:43.169] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 09:42:43.170] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 09:42:43.170] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start_check-1.1.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:42:43.170] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 09:42:43.172] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 09:42:43.172] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Check before start obagent [2023-02-21 09:42:43.173] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 09:42:43.196] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:43.196] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 09:42:43.196] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:43.196] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) port check [2023-02-21 09:42:43.197] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:43.265] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:43.265] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:43.333] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:43.333] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 09:42:43.354] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:43.354] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 09:42:43.354] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:43.354] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) port check [2023-02-21 09:42:43.354] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:43.417] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:43.417] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:43.481] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:43.481] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 09:42:43.503] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:43.503] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 09:42:43.503] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:43.503] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) port check [2023-02-21 09:42:43.503] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:43.566] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:43.566] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:43.631] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:43.694] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 09:42:43.694] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 09:42:43.695] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:42:43.695] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 09:42:43.696] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 09:42:43.697] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Check before start prometheus [2023-02-21 09:42:43.697] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 09:42:43.717] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:43.717] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /data/obdata/prometheus/run/prometheus.pid: 没有那个文件或目录 [2023-02-21 09:42:43.717] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:43.718] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 09:42:43.718] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:43.780] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:43.828] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 09:42:43.828] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 09:42:43.828] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start_check-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:42:43.829] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 09:42:43.830] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 09:42:43.831] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Check before start grafana [2023-02-21 09:42:43.832] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 09:42:43.853] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:43.853] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/146668 [2023-02-21 09:42:43.913] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 09:42:43.914] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/146668: 没有那个文件或目录 [2023-02-21 09:42:43.914] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:43.914] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 09:42:43.914] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:42:43.978] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:44.093] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 09:42:44.093] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 09:42:44.093] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:44.093] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import start [2023-02-21 09:42:44.095] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 09:42:44.096] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Start observer [2023-02-21 09:42:44.096] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:44.120] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:44.120] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 09:42:44.120] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:44.120] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) start command construction [2023-02-21 09:42:44.120] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:44.153] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:44.153] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 09:42:44.153] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:44.153] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) start command construction [2023-02-21 09:42:44.153] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:44.176] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:42:44.176] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 09:42:44.176] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:42:44.176] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) start command construction [2023-02-21 09:42:44.177] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- starting server1(10.253.208.65) observer [2023-02-21 09:42:44.177] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 09:42:44.178] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone1' -n 'obcluster' -c 1 -d '/topevery/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 09:42:44.359] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:44.359] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 delete env LD_LIBRARY_PATH [2023-02-21 09:42:44.360] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- starting server2(10.253.208.67) observer [2023-02-21 09:42:44.360] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 09:42:44.360] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone2' -n 'obcluster' -c 1 -d '/data/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 09:42:44.525] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:44.525] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 delete env LD_LIBRARY_PATH [2023-02-21 09:42:44.525] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- starting server3(10.253.208.172) observer [2023-02-21 09:42:44.526] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 09:42:44.526] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone3' -n 'obcluster' -c 1 -d '/data/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 09:42:45.565] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:45.565] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 delete env LD_LIBRARY_PATH [2023-02-21 09:42:45.661] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] observer program health check [2023-02-21 09:42:48.665] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 09:42:48.665] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:48.689] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:48.689] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/102229 [2023-02-21 09:42:48.751] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:48.751] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid: 102229] started [2023-02-21 09:42:48.751] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 09:42:48.752] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:48.793] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:48.793] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/9618 [2023-02-21 09:42:48.873] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:48.873] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid: 9618] started [2023-02-21 09:42:48.873] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 09:42:48.873] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:42:48.941] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:48.941] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/191772 [2023-02-21 09:42:49.088] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:42:49.088] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid: 191772] started [2023-02-21 09:42:49.188] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 09:42:49.188] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export start [2023-02-21 09:42:49.188] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:49.188] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 09:42:49.221] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 09:42:49.222] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Connect to observer [2023-02-21 09:42:49.222] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 09:42:49.614] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 09:42:49.614] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 09:42:49.614] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 09:42:49.615] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:42:49.615] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 09:42:49.616] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 09:42:49.617] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 09:42:59.708] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 4012:Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. [2023-02-21 09:42:59.708] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- execute sql: alter system bootstrap REGION "sys_region" ZONE "zone1" SERVER "10.253.208.65:2882",REGION "sys_region" ZONE "zone2" SERVER "10.253.208.67:2882",REGION "sys_region" ZONE "zone3" SERVER "10.253.208.172:2882" [2023-02-21 09:42:59.713] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "core.py", line 1446, in start_cluster [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "core.py", line 1552, in _start_cluster [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/bootstrap.py", line 87, in bootstrap [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] cursor.execute(sql) [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 09:42:59.714] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] result.read() [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (4015, 'System error') [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] [2023-02-21 09:42:59.715] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2023-02-21 09:42:59.717] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 09:43:03.289] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 09:43:03.289] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 09:43:03.303] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:43:03.304] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import start [2023-02-21 09:43:03.306] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 09:43:03.308] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Start obproxy [2023-02-21 09:43:03.309] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/obproxy/etc/obproxy_config.bin [2023-02-21 09:43:03.330] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:03.330] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 09:43:03.331] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:43:03.391] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:03.391] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 09:43:03.391] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:03.392] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- starting 10.253.208.63 obproxy [2023-02-21 09:43:03.393] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/obproxy/lib:' [2023-02-21 09:43:03.393] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/obproxy; /data/obdata/obproxy/bin/obproxy -o obproxy_sys_password='',enable_strict_kernel_release=False,enable_cluster_checkout=False,skip_proxy_sys_private_check=True --listen_port 2883 --prometheus_listen_port 2884 --rs_list '10.253.208.65:2881;10.253.208.67:2881;10.253.208.172:2881' --cluster_name 'obcluster' [2023-02-21 09:43:03.591] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:03.592] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 delete env LD_LIBRARY_PATH [2023-02-21 09:43:03.592] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/obproxy/bin/obproxy -o obproxy_sys_password=,enable_strict_kernel_release=False,enable_cluster_checkout=False,skip_proxy_sys_private_check=True --listen_port 2883 --prometheus_listen_port 2884 --rs_list 10.253.208.65:2881;10.253.208.67:2881;10.253.208.172:2881 --cluster_name obcluster$' | grep -v grep | awk '{print $2}' > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:43:03.697] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:03.701] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] obproxy program health check [2023-02-21 09:43:03.701] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:03.702] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:43:03.763] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:03.763] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:03.827] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:03.827] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 19 [2023-02-21 09:43:04.828] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:04.829] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:43:04.852] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:04.852] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:04.917] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:04.917] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 18 [2023-02-21 09:43:05.918] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:05.919] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:43:05.940] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:05.941] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:06.004] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:06.005] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 17 [2023-02-21 09:43:07.006] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:07.006] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:43:07.028] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:07.028] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:07.090] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:07.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 2104272879 [2023-02-21 09:43:07.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:07.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/213932/fd/ |grep -E 'socket:\[(2104272879)\]' [2023-02-21 09:43:07.153] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:07.153] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 09:43:07.216] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 09:43:07.216] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/146011: 没有那个文件或目录 [2023-02-21 09:43:07.216] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:07.216] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: echo 213932 > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:43:07.275] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:07.354] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 09:43:07.355] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/obproxy && rm -fr /data/obdata/obproxy/obproxyd.sh [2023-02-21 09:43:07.376] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:07.376] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /data/obdata/obproxy/obproxyd.sh [2023-02-21 09:43:07.419] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/obproxy/obproxyd.sh [2023-02-21 09:43:07.439] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:07.440] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash /data/obdata/obproxy/obproxyd.sh /data/obdata/obproxy 10.253.208.63 2883 [2023-02-21 09:43:07.504] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:08.506] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:08.506] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:43:08.528] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:08.528] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:08.593] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:08.594] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 15 [2023-02-21 09:43:09.596] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:09.596] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:43:09.618] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:09.618] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:09.682] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:09.683] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 14 [2023-02-21 09:43:10.684] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:10.684] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:43:10.707] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:10.707] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:10.770] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:10.771] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 2104277169 [2023-02-21 09:43:10.771] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:10.771] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/214207/fd/ |grep -E 'socket:\[(2104277169)\]' [2023-02-21 09:43:10.838] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:10.838] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 09:43:10.905] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:10.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid: 214207] started [2023-02-21 09:43:11.003] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 09:43:11.003] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export start [2023-02-21 09:43:11.003] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:43:11.003] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 09:43:11.005] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 09:43:11.005] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Connect to obproxy [2023-02-21 09:43:11.006] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- connect 10.253.208.63 -P2883 -uroot@proxysys -p [2023-02-21 09:43:11.137] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 09:43:11.137] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 09:43:11.138] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 09:43:11.138] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:43:11.139] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 09:43:11.139] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 09:43:11.140] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set observer_sys_password = [2023-02-21 09:43:11.162] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set obproxy_sys_password = [2023-02-21 09:43:11.182] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 09:43:11.182] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 09:43:11.269] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:43:11.269] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import start [2023-02-21 09:43:11.358] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 09:43:11.359] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Start obagent [2023-02-21 09:43:11.396] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 09:43:11.423] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:11.423] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 09:43:11.423] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:11.424] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:11.513] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 09:43:11.514] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:11.539] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:11.540] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpo7tv_m1o.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:11.586] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:11.611] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:11.614] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:11.615] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:11.678] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:11.678] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpgqg8k9aw.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:11.723] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:11.748] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:11.751] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:11.752] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:11.813] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:11.814] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp5an1bmar.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:11.860] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:11.884] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:11.888] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 09:43:11.889] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 09:43:11.949] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:11.949] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpyrmzcmop.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 09:43:11.995] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 09:43:12.019] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:12.021] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:12.022] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:12.081] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:12.082] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmplnkptfls.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:12.128] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:12.154] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:12.157] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:12.157] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:12.220] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:12.220] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpfjb9m1h1.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:12.266] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:12.290] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:12.293] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:12.294] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:12.355] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:12.355] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpfgu0jk1g.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:12.404] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:12.427] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:12.433] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:12.434] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:12.491] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:12.492] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp0hvcesm8.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:12.537] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:12.559] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:12.563] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:12.564] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:12.624] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:12.624] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpyjwup81e.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:12.669] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:12.691] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:12.697] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 09:43:12.754] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:12.754] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp5je15thd.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 09:43:12.800] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 09:43:12.822] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:12.826] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 09:43:12.884] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:12.885] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 09:43:12.908] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:12.909] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 09:43:12.909] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:12.910] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:12.994] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 09:43:12.994] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:13.015] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:13.016] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpqbjk6hq7.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:13.065] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:13.086] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:13.090] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:13.090] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:13.150] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:13.151] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpivowj46n.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:13.199] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:13.221] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:13.224] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:13.225] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:13.290] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:13.290] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpoxcbxko_.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:13.339] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:13.362] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:13.365] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 09:43:13.365] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 09:43:13.423] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:13.423] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp40qte5b3.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 09:43:13.469] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 09:43:13.490] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:13.493] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:13.493] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:13.552] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:13.553] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp5jo6nsbv.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:13.601] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:13.624] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:13.626] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:13.627] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:13.688] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:13.689] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp5_tbzi14.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:13.738] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:13.761] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:13.765] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:13.766] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:13.823] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:13.824] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpw_dt8pd2.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:13.877] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:13.900] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:13.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:13.906] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:13.962] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:13.962] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp1jc_xzht.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:14.011] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:14.033] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:14.038] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:14.038] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:14.098] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:14.098] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp8rjzb14i.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:14.148] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:14.172] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:14.178] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 09:43:14.236] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:14.237] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpnq8s1vtt.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 09:43:14.286] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 09:43:14.308] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:14.312] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 09:43:14.375] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:14.376] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 09:43:14.409] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:14.409] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 09:43:14.409] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:14.410] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:14.507] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 09:43:14.507] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:14.539] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:14.539] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp5u44pad4.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:14.585] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 09:43:14.609] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:14.613] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:14.614] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:14.676] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:14.677] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp8m1arplq.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:14.723] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 09:43:14.749] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:14.752] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:14.753] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:14.814] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:14.814] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmp2x3p3iy9.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:14.859] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 09:43:14.890] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:14.893] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 09:43:14.893] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 09:43:14.958] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:14.958] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpsfmk4tj8.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 09:43:15.003] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 09:43:15.032] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:15.034] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:15.034] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:15.099] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:15.099] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpmxvtnbbc.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:15.144] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 09:43:15.168] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:15.170] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:15.171] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:15.234] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:15.234] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpieh55suz.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:15.280] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 09:43:15.303] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:15.307] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:15.307] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:15.374] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:15.375] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpf3jifd87.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:15.423] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 09:43:15.450] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:15.456] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:15.456] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:15.519] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:15.520] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpf15dhkn_.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:15.565] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 09:43:15.590] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:15.593] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:15.594] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:15.660] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:15.660] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmphwa_aqqn.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:15.705] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 09:43:15.732] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:15.738] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 09:43:15.811] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:15.811] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpx9fd5xh0.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 09:43:15.869] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 09:43:15.900] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:15.902] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 09:43:15.969] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:16.053] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] obagent program health check [2023-02-21 09:43:17.055] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 09:43:17.055] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 09:43:17.078] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.079] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:17.147] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.147] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 09:43:17.148] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 09:43:17.173] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.173] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:17.241] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.242] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 09:43:17.242] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 09:43:17.266] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.267] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:17.355] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.356] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- start to sync target config [2023-02-21 09:43:17.357] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 09:43:17.358] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export start [2023-02-21 09:43:17.358] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call obagent-py_script_connect-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:43:17.358] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 09:43:17.359] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 09:43:17.359] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 09:43:17.359] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 09:43:17.359] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:43:17.360] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import start [2023-02-21 09:43:17.364] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 09:43:17.364] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Start promethues [2023-02-21 09:43:17.365] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/.prometheus_started [2023-02-21 09:43:17.387] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.388] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/prometheus.yaml [2023-02-21 09:43:17.447] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.448] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/prometheus.yaml [2023-02-21 09:43:17.507] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- write global: [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] scrape_interval: 1s [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] evaluation_interval: 10s [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] rule_files: [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - rules/*rules.yaml [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] scrape_configs: [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - job_name: prometheus [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] metrics_path: /metrics [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 09:43:17.541] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.63:9090 [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - job_name: node [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] password: root [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] metrics_path: /metrics/node/host [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - files: [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - job_name: ob_basic [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] password: root [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/basic [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 09:43:17.542] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - files: [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - job_name: ob_extra [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] password: root [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/extra [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - files: [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - job_name: agent [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] password: root [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] metrics_path: /metrics/stat [2023-02-21 09:43:17.543] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 09:43:17.544] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 09:43:17.544] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 09:43:17.544] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 09:43:17.544] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 09:43:17.544] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 09:43:17.544] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 09:43:17.544] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - files: [2023-02-21 09:43:17.544] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - targets/*.yaml to admin@10.253.208.63:22: /data/obdata/prometheus/prometheus.yaml [2023-02-21 09:43:17.544] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheus.yaml [2023-02-21 09:43:17.574] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.575] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpd8ntg4hv to /data/obdata/prometheus/prometheus.yaml [2023-02-21 09:43:17.621] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/prometheus/prometheus.yaml [2023-02-21 09:43:17.641] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:17.644] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 09:43:17.702] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.703] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 09:43:17.747] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 09:43:17.767] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:17.767] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle --start-only [2023-02-21 09:43:17.870] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:17.871] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheus.pid` && ls /proc/$pid [2023-02-21 09:43:17.935] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:19.018] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] prometheus program health check [2023-02-21 09:43:19.019] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:19.019] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 09:43:19.042] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:19.150] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 09:43:19.151] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export start [2023-02-21 09:43:19.151] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:43:19.151] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 09:43:19.152] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 09:43:19.153] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Connect to Prometheus [2023-02-21 09:43:19.153] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- connect prometheus (10.253.208.63:9090 by user None) [2023-02-21 09:43:19.154] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 09:43:19.290] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 09:43:19.290] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 09:43:19.290] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 09:43:19.291] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:43:19.291] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 09:43:19.292] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 09:43:19.293] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: touch /data/obdata/prometheus/.prometheus_started [2023-02-21 09:43:19.320] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:19.320] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 09:43:19.320] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 09:43:19.423] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:43:19.424] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import start [2023-02-21 09:43:19.427] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 09:43:19.427] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Start grafana [2023-02-21 09:43:19.428] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate obd-grafana ini file [2023-02-21 09:43:19.429] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf && rm -fr /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 09:43:19.458] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:19.459] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpbo3fy27u.ini to /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 09:43:19.505] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 09:43:19.529] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:19.531] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate datasources yaml [2023-02-21 09:43:19.535] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 09:43:19.535] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] datasources: [2023-02-21 09:43:19.535] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - name: OB-Prometheus [2023-02-21 09:43:19.535] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] isDefault: 'true' [2023-02-21 09:43:19.535] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] type: prometheus [2023-02-21 09:43:19.535] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] access: proxy [2023-02-21 09:43:19.536] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] editable: 'true' [2023-02-21 09:43:19.536] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] url: http://10.253.208.63:9090 to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 09:43:19.536] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/datasources && rm -fr /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 09:43:19.596] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:19.596] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpyj7vewpi to /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 09:43:19.641] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 09:43:19.666] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:19.669] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate providers yaml [2023-02-21 09:43:19.671] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 09:43:19.671] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] providers: [2023-02-21 09:43:19.671] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - name: OceanBase Metrics [2023-02-21 09:43:19.671] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] type: file [2023-02-21 09:43:19.671] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] allowUiUpdates: 'true' [2023-02-21 09:43:19.671] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] options: [2023-02-21 09:43:19.671] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] path: /data/obdata/grafana/conf/provisioning/dashboards/templates to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 09:43:19.672] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 09:43:19.733] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:19.733] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send /tmp/tmpi0dfmt62 to /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 09:43:19.779] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 09:43:19.802] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 09:43:19.806] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 09:43:19.900] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:19.901] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/grafana; bash -c '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid > /data/obdata/grafana/data/log/grafana-console.log 2>&1 &' [2023-02-21 09:43:19.968] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:19.969] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 09:43:20.050] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:21.084] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] grafana program health check [2023-02-21 09:43:21.084] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:21.084] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:21.085] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:21.110] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:21.110] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:21.170] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:21.171] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:21.171] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:21.171] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 19 [2023-02-21 09:43:22.172] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:22.172] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:22.172] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:22.197] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:22.197] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:22.258] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:22.259] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:22.259] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:22.259] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 18 [2023-02-21 09:43:23.261] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:23.261] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:23.261] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:23.285] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:23.286] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:23.346] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:23.346] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:23.346] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:23.346] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 17 [2023-02-21 09:43:24.348] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:24.348] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:24.348] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:24.372] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:24.373] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:24.433] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:24.433] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:24.433] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:24.433] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 16 [2023-02-21 09:43:25.434] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:25.435] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:25.435] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:25.461] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:25.462] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:25.523] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:25.524] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:25.524] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:25.524] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 15 [2023-02-21 09:43:26.525] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:26.526] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:26.526] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:26.550] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:26.551] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:26.610] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:26.610] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:26.610] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:26.611] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 14 [2023-02-21 09:43:27.612] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:27.612] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:27.612] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:27.637] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:27.637] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:27.695] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:27.696] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:27.696] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:27.696] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 13 [2023-02-21 09:43:28.697] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:28.697] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:28.697] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:28.722] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:28.723] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:28.782] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:28.782] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:28.782] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:28.783] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 12 [2023-02-21 09:43:29.784] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:29.784] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:29.784] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:29.809] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:29.810] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:29.872] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:29.872] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:29.872] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:29.872] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 11 [2023-02-21 09:43:30.873] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:30.873] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:30.873] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:30.898] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:30.899] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:30.961] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:30.962] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:30.962] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:30.962] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 10 [2023-02-21 09:43:31.963] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:31.963] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:31.963] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:31.990] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:31.990] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:32.051] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:32.051] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:32.051] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:32.052] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 9 [2023-02-21 09:43:33.053] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:33.053] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:33.053] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:33.080] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:33.080] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:33.141] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:33.141] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:33.142] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:33.142] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 8 [2023-02-21 09:43:34.143] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:34.143] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:34.143] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:34.168] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:34.168] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:34.228] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:34.228] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:34.228] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:34.228] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 7 [2023-02-21 09:43:35.229] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:35.230] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:35.230] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:35.259] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:35.259] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:35.321] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:35.321] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:35.322] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:35.322] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 6 [2023-02-21 09:43:36.323] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:36.323] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:36.323] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:36.350] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:36.350] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:36.411] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:36.411] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:36.411] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:36.411] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 5 [2023-02-21 09:43:37.412] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:37.413] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:37.413] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:37.438] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:37.438] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:37.499] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:37.499] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:37.499] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:37.499] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 4 [2023-02-21 09:43:38.500] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:38.501] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:38.501] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:38.525] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:38.525] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:38.584] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:38.584] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:38.584] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:38.584] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 3 [2023-02-21 09:43:39.585] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:39.586] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:39.586] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:39.610] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:39.611] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:39.669] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:39.670] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:39.670] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:39.670] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 2 [2023-02-21 09:43:40.671] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:40.671] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:40.671] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:40.697] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:40.697] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:40.756] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:40.756] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:40.757] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:40.757] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 1 [2023-02-21 09:43:41.758] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 09:43:41.758] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f9849f2e518>: ['']} [2023-02-21 09:43:41.758] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:43:41.784] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:41.785] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104276503)\]' [2023-02-21 09:43:41.847] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 09:43:41.847] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 09:43:41.847] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] [2023-02-21 09:43:41.847] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 0 [2023-02-21 09:43:41.943] [063caa20-b189-11ed-ac32-fa163e9e21e4] [WARNING] [WARN] failed to start 10.253.208.63 grafana [2023-02-21 09:43:41.943] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 09:43:41.943] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export start [2023-02-21 09:43:41.944] [063caa20-b189-11ed-ac32-fa163e9e21e4] [ERROR] [ERROR] grafana start failed [2023-02-21 09:43:41.944] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:43:41.944] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import display [2023-02-21 09:43:41.945] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 09:43:41.945] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] Wait for observer init [2023-02-21 09:43:41.950] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 09:43:41.950] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | observer | [2023-02-21 09:43:41.950] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 09:43:41.950] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 09:43:41.950] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 09:43:41.950] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 09:43:41.950] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 09:43:41.950] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 09:43:41.950] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 09:43:41.950] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 09:43:42.076] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | observer | [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export display [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:43:42.077] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import display [2023-02-21 09:43:42.078] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 09:43:42.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +-------------------------------------------------+ [2023-02-21 09:43:42.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | obproxy | [2023-02-21 09:43:42.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 09:43:42.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | ip | port | prometheus_port | status | [2023-02-21 09:43:42.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 09:43:42.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | 10.253.208.63 | 2883 | 2884 | active | [2023-02-21 09:43:42.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 09:43:42.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] obclient -h10.253.208.63 -P2883 -uroot -Doceanbase -A [2023-02-21 09:43:42.091] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 09:43:42.092] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export display [2023-02-21 09:43:42.092] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call obagent-py_script_display-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:43:42.092] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import display [2023-02-21 09:43:42.092] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 09:43:42.093] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.65:8088/metrics/stat" [2023-02-21 09:43:42.137] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:42.138] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.67:8088/metrics/stat" [2023-02-21 09:43:42.187] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:42.188] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.172:8088/metrics/stat" [2023-02-21 09:43:42.236] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:43:42.237] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +----------------------------------------------------+ [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | obagent | [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | ip | server_port | pprof_port | status | [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | 10.253.208.65 | 8088 | 8089 | active | [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | 10.253.208.67 | 8088 | 8089 | active | [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | 10.253.208.172 | 8088 | 8089 | active | [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export display [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:43:42.238] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - import display [2023-02-21 09:43:42.239] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 09:43:42.239] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 09:43:42.243] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +------------------------------------------------------+ [2023-02-21 09:43:42.243] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | prometheus | [2023-02-21 09:43:42.243] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 09:43:42.243] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 09:43:42.243] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 09:43:42.243] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] | http://10.253.208.63:9090 | | | active | [2023-02-21 09:43:42.243] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 09:43:42.243] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 09:43:42.243] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - export display [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 09:43:42.244] [063caa20-b189-11ed-ac32-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 09:57:39.393] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 09:57:39.394] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 09:57:39.394] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 09:57:39.394] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 09:57:39.394] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None} [2023-02-21 09:57:39.394] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 09:57:39.394] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 09:57:39.394] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 09:57:39.395] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 09:57:39.395] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 09:57:39.405] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Check the deploy status [2023-02-21 09:57:39.405] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 09:57:39.407] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 09:57:39.407] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:57:39.408] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 09:57:39.408] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 09:57:39.410] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:57:39.410] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 09:57:39.413] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:57:39.413] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 09:57:39.416] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:57:39.416] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 09:57:39.418] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:57:39.418] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 09:57:39.538] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 09:57:39.581] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [INFO] Search plugins [2023-02-21 09:57:39.582] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 09:57:39.582] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 09:57:39.582] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 09:57:39.583] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 09:57:39.583] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:57:40.250] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 09:57:40.250] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 09:57:40.250] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:57:40.414] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 09:57:40.414] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 09:57:40.414] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:57:40.510] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 09:57:40.511] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 09:57:40.511] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:57:40.532] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 09:57:40.532] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 09:57:40.532] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:57:40.564] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Searching stop plugin for components ... [2023-02-21 09:57:40.564] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:57:40.565] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 09:57:40.565] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:57:40.565] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 09:57:40.565] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Searching stop plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:57:40.565] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_stop-0.1 for obagent-1.2.0 [2023-02-21 09:57:40.566] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Searching stop plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:57:40.566] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_stop-2.37.1 for prometheus-2.37.1 [2023-02-21 09:57:40.566] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Searching stop plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:57:40.566] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_stop-7.5.17 for grafana-7.5.17 [2023-02-21 09:57:40.617] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 09:57:41.660] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 09:57:41.660] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 09:57:41.662] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 09:57:41.663] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [INFO] Stop observer [2023-02-21 09:57:41.664] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:57:41.776] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:41.776] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ps uax | egrep " 102229 " | grep -v grep [2023-02-21 09:57:41.885] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:41.885] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid:102229] stopping ... [2023-02-21 09:57:41.885] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: kill -9 102229 [2023-02-21 09:57:41.950] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:41.951] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:57:41.990] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:41.991] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ps uax | egrep " 9618 " | grep -v grep [2023-02-21 09:57:42.091] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:42.091] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid:9618] stopping ... [2023-02-21 09:57:42.092] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: kill -9 9618 [2023-02-21 09:57:42.158] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:42.159] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 09:57:42.184] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:42.184] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ps uax | egrep " 191772 " | grep -v grep [2023-02-21 09:57:42.264] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:42.265] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid:191772] stopping ... [2023-02-21 09:57:42.265] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: kill -9 191772 [2023-02-21 09:57:42.326] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.328] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) check whether the port is released [2023-02-21 09:57:43.328] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:43.356] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.357] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:43.422] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.423] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 09:57:43.486] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.486] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer is stopped [2023-02-21 09:57:43.487] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) check whether the port is released [2023-02-21 09:57:43.487] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:43.512] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.512] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:43.573] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.574] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 09:57:43.633] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.633] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer is stopped [2023-02-21 09:57:43.633] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) check whether the port is released [2023-02-21 09:57:43.633] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:43.659] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.660] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:43.724] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.724] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 09:57:43.789] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.789] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer is stopped [2023-02-21 09:57:43.879] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 09:57:43.879] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 09:57:43.879] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 09:57:43.880] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 09:57:43.881] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 09:57:43.881] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [INFO] Stop obproxy [2023-02-21 09:57:43.883] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:57:43.905] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.906] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/214207 [2023-02-21 09:57:43.965] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:43.966] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/214207/fd [2023-02-21 09:57:44.027] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:44.027] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid:214207] stopping ... [2023-02-21 09:57:44.027] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid | xargs kill -9; kill -9 -214207 [2023-02-21 09:57:44.089] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.090] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 09:57:45.090] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:45.117] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.117] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:45.185] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.186] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -f /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 09:57:45.247] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.247] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy is stopped [2023-02-21 09:57:45.316] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 09:57:45.316] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 09:57:45.316] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Call obagent-py_script_stop-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 09:57:45.316] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 09:57:45.317] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 09:57:45.318] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [INFO] Stop obagent [2023-02-21 09:57:45.319] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 09:57:45.340] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.341] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/103073 [2023-02-21 09:57:45.401] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.401] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent[pid:103073] stopping ... [2023-02-21 09:57:45.401] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: kill -9 103073 [2023-02-21 09:57:45.461] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.461] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 09:57:45.483] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.483] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/10563 [2023-02-21 09:57:45.545] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.545] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent[pid:10563] stopping ... [2023-02-21 09:57:45.545] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: kill -9 10563 [2023-02-21 09:57:45.603] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.603] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 09:57:45.627] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.627] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/192632 [2023-02-21 09:57:45.694] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:45.694] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent[pid:192632] stopping ... [2023-02-21 09:57:45.695] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: kill -9 192632 [2023-02-21 09:57:45.758] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:46.759] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) check whether the port is released [2023-02-21 09:57:46.760] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:46.789] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:46.789] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:46.857] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:46.857] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 09:57:46.918] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:46.918] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent is stopped [2023-02-21 09:57:46.918] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) check whether the port is released [2023-02-21 09:57:46.919] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:46.945] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:46.946] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:47.009] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:47.010] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 09:57:47.070] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:47.070] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent is stopped [2023-02-21 09:57:47.070] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) check whether the port is released [2023-02-21 09:57:47.070] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:47.096] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:47.096] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:47.160] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:47.161] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 09:57:47.222] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:47.222] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent is stopped [2023-02-21 09:57:47.274] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 09:57:47.274] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 09:57:47.274] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_stop-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 09:57:47.274] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 09:57:47.275] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 09:57:47.276] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [INFO] Stop prometheus [2023-02-21 09:57:47.276] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 09:57:47.301] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:47.301] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus is not running [2023-02-21 09:57:48.320] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 09:57:48.320] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 09:57:48.320] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Call grafana-py_script_stop-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 09:57:48.320] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 09:57:48.322] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 09:57:48.323] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [INFO] Stop grafana [2023-02-21 09:57:48.324] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 09:57:48.345] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:48.345] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/214701 [2023-02-21 09:57:48.407] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:48.408] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/214701/fd [2023-02-21 09:57:48.467] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:48.467] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana[pid:214701] stopping... [2023-02-21 09:57:48.467] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: kill -9 214701 [2023-02-21 09:57:48.528] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:49.530] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 09:57:49.530] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 09:57:49.556] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 09:57:49.556] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana is stopped [2023-02-21 09:57:49.628] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 09:57:49.628] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 09:57:49.629] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - Set observer deploy status to stopped [2023-02-21 09:57:49.629] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 09:57:49.635] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [INFO] observer stopped [2023-02-21 09:57:49.635] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 09:57:49.635] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 09:57:49.635] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 09:57:49.635] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 09:57:49.635] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 09:57:49.636] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 09:57:49.636] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 09:57:49.636] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 09:57:49.636] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 09:57:49.636] [1ed0c272-b18b-11ed-b4f0-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 10:01:52.878] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 10:01:52.879] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 10:01:52.879] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 10:01:52.879] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 10:01:52.879] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2023-02-21 10:01:52.879] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 10:01:52.879] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 10:01:52.879] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 10:01:52.880] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 10:01:52.880] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 10:01:52.891] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 10:01:52.891] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 10:01:52.892] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 10:01:52.892] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:01:52.892] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: 4.0.0.0, tag: 1d56dc742f5f05a2d15797d291b51a94019e728d, release: None, package_hash: None [2023-02-21 10:01:52.892] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 10:01:52.892] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 10:01:52.893] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2023-02-21 10:01:52.895] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:01:52.895] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:01:52.895] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: de53232a951184fad75b15884458d85e31d2f6c3, release: None, package_hash: None [2023-02-21 10:01:52.895] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 10:01:52.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2023-02-21 10:01:52.898] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:01:52.898] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:01:52.898] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Search repository obagent version: 1.2.0, tag: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e, release: None, package_hash: None [2023-02-21 10:01:52.898] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 10:01:52.898] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obagent [2023-02-21 10:01:52.901] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:01:52.901] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:01:52.901] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Search repository prometheus version: 2.37.1, tag: 58913c7606f05feb01bc1c6410346e5fc31cf263, release: None, package_hash: None [2023-02-21 10:01:52.901] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 10:01:52.901] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/prometheus [2023-02-21 10:01:52.904] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:01:52.904] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:01:52.904] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Search repository grafana version: 7.5.17, tag: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, release: None, package_hash: None [2023-02-21 10:01:52.904] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 10:01:52.904] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/grafana [2023-02-21 10:01:52.907] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:01:53.022] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 10:01:53.067] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Search plugins [2023-02-21 10:01:53.067] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start_check plugin for components ... [2023-02-21 10:01:53.068] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:01:53.068] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 10:01:53.069] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:01:53.069] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:01:53.070] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:01:53.070] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:01:53.070] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start_check-1.1.1 for obagent-1.2.0 [2023-02-21 10:01:53.070] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start_check plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:01:53.070] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1 [2023-02-21 10:01:53.070] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start_check plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:01:53.070] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start_check-7.5.17 for grafana-7.5.17 [2023-02-21 10:01:53.070] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 10:01:53.071] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:01:53.071] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:01:53.071] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:01:53.071] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:01:53.071] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:01:53.072] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 10:01:53.072] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:01:53.072] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 10:01:53.072] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:01:53.072] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 10:01:53.072] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 10:01:53.072] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:01:53.073] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:01:53.073] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:01:53.073] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:01:53.073] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:01:53.073] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 10:01:53.073] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:01:53.074] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 10:01:53.074] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:01:53.074] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 10:01:53.074] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 10:01:53.074] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:01:53.075] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:01:53.075] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:01:53.075] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:01:53.075] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:01:53.075] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 10:01:53.075] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:01:53.075] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 10:01:53.075] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:01:53.076] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 10:01:53.076] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 10:01:53.076] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:01:53.076] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:01:53.076] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:01:53.076] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:01:53.077] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:01:53.077] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 10:01:53.077] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:01:53.077] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 10:01:53.077] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:01:53.077] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 10:01:53.199] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 10:01:54.374] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 10:01:54.376] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 10:01:54.376] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 10:01:54.376] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:01:54.377] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:01:55.088] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 10:01:55.088] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:01:55.088] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:01:55.254] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 10:01:55.255] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 10:01:55.255] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:01:55.354] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 10:01:55.354] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 10:01:55.354] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:01:55.376] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 10:01:55.376] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 10:01:55.376] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:01:55.541] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:01:55.542] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 10:01:55.545] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 10:01:55.546] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Check before start observer [2023-02-21 10:01:55.547] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:01:55.581] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:01:55.581] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:01:55.581] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:55.581] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) port check [2023-02-21 10:01:55.581] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:55.646] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:55.647] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:55.714] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:55.715] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /topevery/obdata/sstable/block_file [2023-02-21 10:01:55.777] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:55.778] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:01:55.812] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:01:55.812] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:01:55.813] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:55.813] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) port check [2023-02-21 10:01:55.813] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:55.878] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:55.879] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:55.940] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:55.941] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /data/obdata/sstable/block_file [2023-02-21 10:01:56.002] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.003] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:01:56.026] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:01:56.026] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:01:56.026] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:56.026] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) port check [2023-02-21 10:01:56.026] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:56.091] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.092] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:56.155] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.156] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /data/obdata/sstable/block_file [2023-02-21 10:01:56.216] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.217] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 10:01:56.239] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.239] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ulimit -a [2023-02-21 10:01:56.298] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.299] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.65) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:01:56.299] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/meminfo [2023-02-21 10:01:56.356] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.357] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [WARNING] [WARN] OBD-2000: (10.253.208.65) not enough memory. (Free: 5.1G, Need: 10.0G) [2023-02-21 10:01:56.357] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: df --block-size=1024 [2023-02-21 10:01:56.419] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.419] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 51118538752, 'need': 0}, '/dev': {'total': 20979048448, 'avail': 20979048448, 'need': 0}, '/dev/shm': {'total': 20991266816, 'avail': 20991266816, 'need': 0}, '/run': {'total': 20991266816, 'avail': 20006989824, 'need': 0}, '/sys/fs/cgroup': {'total': 20991266816, 'avail': 20991266816, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 889667584, 'need': 0}, '/home': {'total': 44127686656, 'avail': 42821672960, 'need': 0}, '/topevery': {'total': 2113643364352, 'avail': 660666527744, 'need': 0}, '/run/user/0': {'total': 4198256640, 'avail': 4198256640, 'need': 0}, '/run/user/1001': {'total': 4198256640, 'avail': 4198256640, 'need': 0}} [2023-02-21 10:01:56.420] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 10:01:56.441] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.442] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ulimit -a [2023-02-21 10:01:56.501] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.501] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.67) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:01:56.501] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/meminfo [2023-02-21 10:01:56.561] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.562] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: df --block-size=1024 [2023-02-21 10:01:56.626] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.626] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 50947309568, 'need': 0}, '/dev': {'total': 8296525824, 'avail': 8296525824, 'need': 0}, '/dev/shm': {'total': 8308740096, 'avail': 8308736000, 'need': 0}, '/run': {'total': 8308740096, 'avail': 7425159168, 'need': 0}, '/sys/fs/cgroup': {'total': 8308740096, 'avail': 8308740096, 'need': 0}, '/data': {'total': 211242950656, 'avail': 60839264256, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 889667584, 'need': 0}, '/home': {'total': 44127686656, 'avail': 42818347008, 'need': 0}, '/run/user/0': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1001': {'total': 1661751296, 'avail': 1661751296, 'need': 0}} [2023-02-21 10:01:56.626] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 10:01:56.648] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.648] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ulimit -a [2023-02-21 10:01:56.709] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.710] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.172) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:01:56.710] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/meminfo [2023-02-21 10:01:56.771] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.772] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: df --block-size=1024 [2023-02-21 10:01:56.834] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.834] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 41952239616, 'need': 0}, '/dev': {'total': 8291450880, 'avail': 8291450880, 'need': 0}, '/dev/shm': {'total': 8308744192, 'avail': 8308715520, 'need': 0}, '/run': {'total': 8308744192, 'avail': 8079097856, 'need': 0}, '/sys/fs/cgroup': {'total': 8308744192, 'avail': 8308744192, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 844517376, 'need': 0}, '/home': {'total': 48420556800, 'avail': 47123808256, 'need': 0}, '/data': {'total': 316924559360, 'avail': 161148334080, 'need': 0}, '/run/user/0': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1002': {'total': 1661751296, 'avail': 1661751296, 'need': 0}} [2023-02-21 10:01:56.834] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: date +%s%N [2023-02-21 10:01:56.856] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.857] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.65 time delta -2.255615234375 [2023-02-21 10:01:56.857] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: date +%s%N [2023-02-21 10:01:56.877] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.877] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.67 time delta -2.004150390625 [2023-02-21 10:01:56.878] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: date +%s%N [2023-02-21 10:01:56.899] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:56.899] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.172 time delta -2.11376953125 [2023-02-21 10:01:56.982] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.65) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:01:56.982] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] [WARN] OBD-2000: (10.253.208.65) not enough memory. (Free: 5.1G, Need: 10.0G) [2023-02-21 10:01:56.982] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.67) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:01:56.982] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.172) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:01:56.982] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] [2023-02-21 10:01:56.982] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 10:01:56.982] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 10:01:56.983] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:01:56.983] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 10:01:56.984] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 10:01:56.984] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Check before start obproxy [2023-02-21 10:01:56.992] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:01:57.017] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:01:57.017] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 10:01:57.017] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:57.018] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 10:01:57.018] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:57.080] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.080] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:57.143] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.246] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 10:01:57.246] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 10:01:57.246] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start_check-1.1.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:01:57.246] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 10:01:57.247] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 10:01:57.247] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Check before start obagent [2023-02-21 10:01:57.248] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:01:57.272] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:01:57.272] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 10:01:57.272] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:57.272] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) port check [2023-02-21 10:01:57.273] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:57.337] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.338] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:57.401] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.402] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:01:57.422] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:01:57.422] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 10:01:57.422] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:57.423] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) port check [2023-02-21 10:01:57.423] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:57.486] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.487] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:57.549] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.549] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:01:57.572] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:01:57.572] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 10:01:57.572] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:57.572] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) port check [2023-02-21 10:01:57.573] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:57.639] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.639] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:57.706] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.771] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 10:01:57.771] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 10:01:57.771] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:01:57.771] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 10:01:57.772] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 10:01:57.773] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Check before start prometheus [2023-02-21 10:01:57.774] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 10:01:57.798] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.798] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 10:01:57.798] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:57.863] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.904] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 10:01:57.904] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 10:01:57.904] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start_check-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:01:57.904] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 10:01:57.905] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 10:01:57.906] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Check before start grafana [2023-02-21 10:01:57.907] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 10:01:57.929] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:57.929] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/214701 [2023-02-21 10:01:57.991] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 10:01:57.991] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/214701: 没有那个文件或目录 [2023-02-21 10:01:57.991] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:57.992] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 10:01:57.992] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:01:58.059] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:58.168] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 10:01:58.168] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 10:01:58.169] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:01:58.169] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import start [2023-02-21 10:01:58.179] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 10:01:58.180] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Start observer [2023-02-21 10:01:58.180] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:01:58.202] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:01:58.203] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:01:58.203] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:58.203] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) start command construction [2023-02-21 10:01:58.203] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:01:58.225] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:01:58.225] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:01:58.225] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:58.225] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) start command construction [2023-02-21 10:01:58.226] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:01:58.250] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:01:58.251] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:01:58.251] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:01:58.251] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) start command construction [2023-02-21 10:01:58.252] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- starting server1(10.253.208.65) observer [2023-02-21 10:01:58.253] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 10:01:58.253] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone1' -n 'obcluster' -c 1 -d '/topevery/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 10:01:58.428] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:58.429] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 delete env LD_LIBRARY_PATH [2023-02-21 10:01:58.429] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- starting server2(10.253.208.67) observer [2023-02-21 10:01:58.429] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 10:01:58.430] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone2' -n 'obcluster' -c 1 -d '/data/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 10:01:58.595] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:58.595] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 delete env LD_LIBRARY_PATH [2023-02-21 10:01:58.596] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- starting server3(10.253.208.172) observer [2023-02-21 10:01:58.596] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 10:01:58.596] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone3' -n 'obcluster' -c 1 -d '/data/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 10:01:59.636] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:01:59.637] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 delete env LD_LIBRARY_PATH [2023-02-21 10:01:59.745] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] observer program health check [2023-02-21 10:02:02.749] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 10:02:02.749] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:02:02.775] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:02.776] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/105271 [2023-02-21 10:02:02.839] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:02.840] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid: 105271] started [2023-02-21 10:02:02.840] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 10:02:02.840] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:02:02.870] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:02.870] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/12704 [2023-02-21 10:02:02.947] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:02.947] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid: 12704] started [2023-02-21 10:02:02.947] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 10:02:02.947] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:02:02.986] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:02.986] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/195440 [2023-02-21 10:02:03.064] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:03.064] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid: 195440] started [2023-02-21 10:02:03.136] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 10:02:03.136] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export start [2023-02-21 10:02:03.136] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:02:03.137] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 10:02:03.177] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 10:02:03.178] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Connect to observer [2023-02-21 10:02:03.178] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 10:02:03.571] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 10:02:03.571] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 10:02:03.572] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 10:02:03.572] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:02:03.572] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 10:02:03.574] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 10:02:03.574] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 10:02:13.583] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 4012:Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. [2023-02-21 10:02:13.583] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- execute sql: alter system bootstrap REGION "sys_region" ZONE "zone1" SERVER "10.253.208.65:2882",REGION "sys_region" ZONE "zone2" SERVER "10.253.208.67:2882",REGION "sys_region" ZONE "zone3" SERVER "10.253.208.172:2882" [2023-02-21 10:02:13.585] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 10:02:13.585] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "core.py", line 1446, in start_cluster [2023-02-21 10:02:13.585] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "core.py", line 1552, in _start_cluster [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/bootstrap.py", line 87, in bootstrap [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] cursor.execute(sql) [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] result.read() [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (4015, 'System error') [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] [2023-02-21 10:02:13.586] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2023-02-21 10:02:13.587] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 10:02:17.371] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 10:02:17.371] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 10:02:17.394] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:02:17.395] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import start [2023-02-21 10:02:17.397] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 10:02:17.399] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Start obproxy [2023-02-21 10:02:17.400] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/obproxy/etc/obproxy_config.bin [2023-02-21 10:02:17.423] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:17.424] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 10:02:17.424] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:02:17.484] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:17.485] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 10:02:17.485] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:17.485] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- starting 10.253.208.63 obproxy [2023-02-21 10:02:17.486] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/obproxy/lib:' [2023-02-21 10:02:17.486] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/obproxy; /data/obdata/obproxy/bin/obproxy -o obproxy_sys_password='',enable_strict_kernel_release=False,enable_cluster_checkout=False,skip_proxy_sys_private_check=True --listen_port 2883 --prometheus_listen_port 2884 --rs_list '10.253.208.65:2881;10.253.208.67:2881;10.253.208.172:2881' --cluster_name 'obcluster' [2023-02-21 10:02:17.707] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:17.707] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 delete env LD_LIBRARY_PATH [2023-02-21 10:02:17.708] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/obproxy/bin/obproxy -o obproxy_sys_password=,enable_strict_kernel_release=False,enable_cluster_checkout=False,skip_proxy_sys_private_check=True --listen_port 2883 --prometheus_listen_port 2884 --rs_list 10.253.208.65:2881;10.253.208.67:2881;10.253.208.172:2881 --cluster_name obcluster$' | grep -v grep | awk '{print $2}' > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:02:17.806] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:17.921] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] obproxy program health check [2023-02-21 10:02:17.922] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:17.922] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:02:17.947] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:17.947] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:18.013] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:18.014] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 19 [2023-02-21 10:02:19.015] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:19.015] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:02:19.037] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:19.037] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:19.101] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:19.101] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 18 [2023-02-21 10:02:20.103] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:20.103] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:02:20.126] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:20.127] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:20.190] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:20.190] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 2104297140 [2023-02-21 10:02:20.190] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:20.190] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/219252/fd/ |grep -E 'socket:\[(2104297140)\]' [2023-02-21 10:02:20.252] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:20.252] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 10:02:20.313] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 10:02:20.314] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/214185: 没有那个文件或目录 [2023-02-21 10:02:20.314] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:20.314] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: echo 219252 > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:02:20.375] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:20.458] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 10:02:20.459] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/obproxy && rm -fr /data/obdata/obproxy/obproxyd.sh [2023-02-21 10:02:20.480] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:20.480] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /data/obdata/obproxy/obproxyd.sh [2023-02-21 10:02:20.523] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/obproxy/obproxyd.sh [2023-02-21 10:02:20.543] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:20.544] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash /data/obdata/obproxy/obproxyd.sh /data/obdata/obproxy 10.253.208.63 2883 [2023-02-21 10:02:20.608] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:21.610] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:21.610] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:02:21.635] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:21.635] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:21.701] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:21.701] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 16 [2023-02-21 10:02:22.702] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:22.702] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:02:22.726] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:22.727] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:22.791] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:22.791] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 15 [2023-02-21 10:02:23.792] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:23.793] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:02:23.815] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:23.815] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:23.880] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:23.880] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 2104297311 [2023-02-21 10:02:23.880] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:23.880] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/219500/fd/ |grep -E 'socket:\[(2104297311)\]' [2023-02-21 10:02:23.941] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:23.942] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 10:02:24.005] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:24.005] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid: 219500] started [2023-02-21 10:02:24.052] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 10:02:24.053] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export start [2023-02-21 10:02:24.053] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:02:24.053] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 10:02:24.055] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 10:02:24.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Connect to obproxy [2023-02-21 10:02:24.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- connect 10.253.208.63 -P2883 -uroot@proxysys -p [2023-02-21 10:02:24.187] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 10:02:24.187] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 10:02:24.188] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 10:02:24.188] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:02:24.189] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 10:02:24.189] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 10:02:24.190] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set observer_sys_password = [2023-02-21 10:02:24.211] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set obproxy_sys_password = [2023-02-21 10:02:24.231] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 10:02:24.231] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 10:02:24.319] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:02:24.319] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import start [2023-02-21 10:02:24.405] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 10:02:24.406] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Start obagent [2023-02-21 10:02:24.443] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:02:24.467] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:24.467] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 10:02:24.467] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:24.468] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:24.551] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 10:02:24.552] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:24.576] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:24.576] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpkeae1u3i.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:24.622] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:24.643] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:24.646] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:24.646] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:24.705] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:24.706] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpzteioyt2.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:24.752] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:24.774] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:24.778] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:24.779] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:24.837] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:24.838] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmptam1degf.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:24.884] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:24.907] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:24.910] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 10:02:24.911] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:02:24.972] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:24.973] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmplzp9u1uy.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:02:25.018] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:02:25.041] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:25.043] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:25.044] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:25.106] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:25.107] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpxnkt2mjs.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:25.151] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:25.174] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:25.177] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:25.177] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:25.238] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:25.238] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpvbc22_d0.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:25.284] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:25.305] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:25.309] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:25.310] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:25.368] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:25.368] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmp597r94ms.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:25.417] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:25.438] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:25.444] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:25.445] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:25.501] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:25.502] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpta27vuxa.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:25.547] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:25.569] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:25.572] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:25.572] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:25.632] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:25.633] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmppqmooba5.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:25.677] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:25.700] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:25.706] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:02:25.764] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:25.764] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpa6ey81q3.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:02:25.809] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:02:25.831] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:25.834] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:02:25.892] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:25.893] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:02:25.932] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:25.932] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 10:02:25.932] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:25.933] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:26.020] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 10:02:26.021] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:26.042] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:26.042] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmp8tulh4ff.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:26.092] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:26.124] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:26.128] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:26.128] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:26.199] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:26.200] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpn3lf3vpj.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:26.251] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:26.280] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:26.284] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:26.284] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:26.348] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:26.348] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpcxjpvfy4.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:26.399] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:26.429] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:26.433] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 10:02:26.433] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:02:26.492] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:26.492] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpoc4ozmyv.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:02:26.540] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:02:26.561] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:26.564] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:26.564] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:26.623] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:26.624] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmp5wsk93mm.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:26.676] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:26.697] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:26.699] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:26.700] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:26.759] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:26.759] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpx2yi179p.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:26.809] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:26.831] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:26.834] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:26.835] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:26.899] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:26.899] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmp0gd81xwz.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:26.954] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:26.976] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:26.981] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:26.982] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:27.041] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:27.041] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpc78ocay3.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:27.089] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:27.110] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:27.113] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:27.114] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:27.177] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:27.177] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpikg0mhhk.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:27.227] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:27.251] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:27.258] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:02:27.315] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:27.316] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpbvajakmq.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:02:27.365] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:02:27.387] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:27.390] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:02:27.452] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:27.453] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:02:27.483] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:27.483] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 10:02:27.483] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:27.484] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:27.567] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 10:02:27.568] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:27.596] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:27.597] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpz1pojyu0.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:27.641] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:02:27.664] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:27.667] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:27.668] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:27.729] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:27.730] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmptsgt56eg.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:27.775] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:02:27.802] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:27.805] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:27.806] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:27.864] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:27.865] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpua92ootp.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:27.910] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:02:27.933] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:27.936] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 10:02:27.937] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:02:28.004] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:28.005] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpkjr8yge_.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:02:28.045] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:02:28.068] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:28.070] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:28.071] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:28.135] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:28.135] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpp9fpo1v_.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:28.179] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:02:28.205] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:28.208] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:28.209] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:28.270] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:28.271] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmp_rk8v59d.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:28.317] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:02:28.345] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:28.349] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:28.349] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:28.416] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:28.417] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmp1vnao7qf.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:28.471] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:02:28.494] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:28.500] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:28.500] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:28.557] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:28.557] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmp92f3r3ak.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:28.606] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:02:28.628] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:28.631] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:28.631] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:28.690] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:28.691] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmp846n40vx.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:28.736] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:02:28.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:28.763] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:02:28.820] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:28.820] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpml93o92n.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:02:28.865] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:02:28.889] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:28.892] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:02:28.952] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:28.995] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] obagent program health check [2023-02-21 10:02:29.997] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 10:02:29.997] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:02:30.019] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.020] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:30.090] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.090] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 10:02:30.090] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:02:30.116] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.117] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:30.193] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.194] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 10:02:30.194] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:02:30.217] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.217] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:30.299] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.300] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- start to sync target config [2023-02-21 10:02:30.429] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 10:02:30.430] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export start [2023-02-21 10:02:30.430] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call obagent-py_script_connect-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:02:30.430] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 10:02:30.431] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 10:02:30.431] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 10:02:30.431] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 10:02:30.431] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:02:30.431] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import start [2023-02-21 10:02:30.434] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 10:02:30.434] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Start promethues [2023-02-21 10:02:30.435] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/.prometheus_started [2023-02-21 10:02:30.457] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.458] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:02:30.518] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.519] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:02:30.580] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- write global: [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] scrape_interval: 1s [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] evaluation_interval: 10s [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] rule_files: [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - rules/*rules.yaml [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] scrape_configs: [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - job_name: prometheus [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] metrics_path: /metrics [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.63:9090 [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - job_name: node [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] password: root [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] metrics_path: /metrics/node/host [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 10:02:30.616] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - files: [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - job_name: ob_basic [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] password: root [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/basic [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - files: [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - job_name: ob_extra [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] password: root [2023-02-21 10:02:30.617] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/extra [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - files: [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - job_name: agent [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] password: root [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] metrics_path: /metrics/stat [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - files: [2023-02-21 10:02:30.618] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - targets/*.yaml to admin@10.253.208.63:22: /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:02:30.619] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:02:30.641] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.641] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpru5zaxjk to /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:02:30.688] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:02:30.706] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:30.709] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 10:02:30.769] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.769] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 10:02:30.814] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 10:02:30.838] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:30.838] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle --start-only [2023-02-21 10:02:30.938] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:30.939] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheus.pid` && ls /proc/$pid [2023-02-21 10:02:31.001] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:32.088] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] prometheus program health check [2023-02-21 10:02:32.089] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:32.089] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 10:02:32.115] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:32.115] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:32.182] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:32.182] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 2104266632 [2023-02-21 10:02:32.182] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:32.183] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/214475/fd/ |grep -E 'socket:\[(2104266632)\]' [2023-02-21 10:02:32.244] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:32.245] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 10:02:32.306] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 10:02:32.306] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/146426: 没有那个文件或目录 [2023-02-21 10:02:32.306] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:32.306] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 10:02:32.366] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:32.367] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 10:02:32.410] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 10:02:32.429] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:32.429] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle [2023-02-21 10:02:32.502] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:33.504] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:33.504] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 10:02:33.528] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:33.528] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:33.600] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:33.600] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 prometheus, remaining retries: 18 [2023-02-21 10:02:34.602] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:34.602] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 10:02:34.643] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:34.644] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:34.716] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:34.716] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 2104295138 [2023-02-21 10:02:34.716] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:34.716] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/219924/fd/ |grep -E 'socket:\[(2104295138)\]' [2023-02-21 10:02:34.782] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:34.782] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 10:02:34.853] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:34.853] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheusd[pid: 219924] started [2023-02-21 10:02:34.964] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 10:02:34.964] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export start [2023-02-21 10:02:34.964] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:02:34.964] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 10:02:34.965] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 10:02:34.966] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Connect to Prometheus [2023-02-21 10:02:34.968] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- connect prometheus (10.253.208.63:9090 by user None) [2023-02-21 10:02:34.968] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 10:02:35.097] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 10:02:35.097] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 10:02:35.097] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 10:02:35.098] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:02:35.098] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 10:02:35.099] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 10:02:35.099] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: touch /data/obdata/prometheus/.prometheus_started [2023-02-21 10:02:35.123] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:35.123] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 10:02:35.123] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 10:02:35.229] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:02:35.229] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import start [2023-02-21 10:02:35.233] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 10:02:35.234] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Start grafana [2023-02-21 10:02:35.235] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate obd-grafana ini file [2023-02-21 10:02:35.236] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf && rm -fr /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 10:02:35.263] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:35.263] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmp2njbp_ul.ini to /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 10:02:35.308] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 10:02:35.330] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:35.332] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate datasources yaml [2023-02-21 10:02:35.334] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 10:02:35.334] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] datasources: [2023-02-21 10:02:35.334] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - name: OB-Prometheus [2023-02-21 10:02:35.334] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] isDefault: 'true' [2023-02-21 10:02:35.334] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] type: prometheus [2023-02-21 10:02:35.334] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] access: proxy [2023-02-21 10:02:35.334] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] editable: 'true' [2023-02-21 10:02:35.334] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] url: http://10.253.208.63:9090 to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 10:02:35.335] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/datasources && rm -fr /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 10:02:35.394] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:35.394] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpcf566iqp to /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 10:02:35.441] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 10:02:35.465] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:35.467] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate providers yaml [2023-02-21 10:02:35.470] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 10:02:35.471] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] providers: [2023-02-21 10:02:35.471] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - name: OceanBase Metrics [2023-02-21 10:02:35.471] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] type: file [2023-02-21 10:02:35.471] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] allowUiUpdates: 'true' [2023-02-21 10:02:35.471] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] options: [2023-02-21 10:02:35.471] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] path: /data/obdata/grafana/conf/provisioning/dashboards/templates to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 10:02:35.472] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 10:02:35.531] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:35.532] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send /tmp/tmpjtox7a4f to /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 10:02:35.578] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 10:02:35.602] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:02:35.604] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 10:02:35.696] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:35.696] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/grafana; bash -c '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid > /data/obdata/grafana/data/log/grafana-console.log 2>&1 &' [2023-02-21 10:02:35.768] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:35.769] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 10:02:35.862] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:36.892] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] grafana program health check [2023-02-21 10:02:36.892] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:36.892] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:36.893] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:36.922] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:36.922] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:36.986] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:36.987] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:36.987] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:36.987] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 19 [2023-02-21 10:02:37.989] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:37.992] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:37.993] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:38.020] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:38.020] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:38.083] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:38.083] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:38.084] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:38.084] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 18 [2023-02-21 10:02:39.085] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:39.085] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:39.085] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:39.115] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:39.116] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:39.179] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:39.179] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:39.180] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:39.180] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 17 [2023-02-21 10:02:40.181] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:40.181] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:40.181] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:40.207] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:40.208] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:40.270] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:40.270] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:40.270] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:40.271] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 16 [2023-02-21 10:02:41.272] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:41.272] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:41.272] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:41.297] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:41.298] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:41.362] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:41.363] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:41.363] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:41.363] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 15 [2023-02-21 10:02:42.364] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:42.364] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:42.364] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:42.391] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:42.392] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:42.454] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:42.454] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:42.454] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:42.455] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 14 [2023-02-21 10:02:43.456] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:43.456] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:43.456] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:43.486] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:43.487] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:43.549] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:43.549] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:43.549] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:43.549] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 13 [2023-02-21 10:02:44.550] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:44.550] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:44.551] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:44.577] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:44.577] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:44.638] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:44.638] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:44.638] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:44.638] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 12 [2023-02-21 10:02:45.640] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:45.640] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:45.640] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:45.664] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:45.665] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:45.726] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:45.726] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:45.726] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:45.726] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 11 [2023-02-21 10:02:46.727] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:46.727] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:46.728] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:46.752] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:46.752] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:46.813] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:46.813] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:46.813] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:46.813] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 10 [2023-02-21 10:02:47.814] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:47.814] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:47.815] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:47.839] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:47.839] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:47.901] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:47.901] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:47.901] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:47.901] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 9 [2023-02-21 10:02:48.902] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:48.902] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:48.902] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:48.928] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:48.929] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:48.990] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:48.990] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:48.991] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:48.991] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 8 [2023-02-21 10:02:49.992] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:49.992] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:49.992] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:50.019] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:50.019] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:50.079] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:50.079] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:50.080] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:50.080] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 7 [2023-02-21 10:02:51.081] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:51.082] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:51.082] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:51.112] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:51.112] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:51.176] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:51.176] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:51.176] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:51.176] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 6 [2023-02-21 10:02:52.177] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:52.178] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:52.178] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:52.205] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:52.205] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:52.267] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:52.267] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:52.267] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:52.268] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 5 [2023-02-21 10:02:53.269] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:53.269] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:53.269] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:53.298] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:53.298] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:53.361] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:53.361] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:53.361] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:53.362] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 4 [2023-02-21 10:02:54.363] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:54.363] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:54.363] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:54.393] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:54.393] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:54.455] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:54.455] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:54.455] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:54.455] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 3 [2023-02-21 10:02:55.456] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:55.457] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:55.457] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:55.486] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:55.486] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:55.550] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:55.550] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:55.550] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:55.550] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 2 [2023-02-21 10:02:56.551] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:56.552] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:56.552] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:56.582] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:56.582] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:56.645] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:56.646] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:56.646] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:56.646] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 1 [2023-02-21 10:02:57.647] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:02:57.647] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcc5bae06d8>: ['']} [2023-02-21 10:02:57.647] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:02:57.675] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:57.675] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104295225)\]' [2023-02-21 10:02:57.739] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:02:57.739] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:02:57.739] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] [2023-02-21 10:02:57.740] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 0 [2023-02-21 10:02:57.750] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [WARNING] [WARN] failed to start 10.253.208.63 grafana [2023-02-21 10:02:57.750] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 10:02:57.750] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export start [2023-02-21 10:02:57.750] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [ERROR] [ERROR] grafana start failed [2023-02-21 10:02:57.751] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:02:57.751] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import display [2023-02-21 10:02:57.751] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 10:02:57.752] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] Wait for observer init [2023-02-21 10:02:57.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 10:02:57.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | observer | [2023-02-21 10:02:57.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:02:57.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 10:02:57.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:02:57.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 10:02:57.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 10:02:57.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 10:02:57.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:02:57.757] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 10:02:57.883] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 10:02:57.883] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | observer | [2023-02-21 10:02:57.883] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:02:57.883] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 10:02:57.883] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:02:57.883] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 10:02:57.884] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 10:02:57.884] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 10:02:57.884] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:02:57.884] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 10:02:57.884] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] [2023-02-21 10:02:57.884] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 10:02:57.884] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export display [2023-02-21 10:02:57.884] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:02:57.884] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import display [2023-02-21 10:02:57.885] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 10:02:57.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +-------------------------------------------------+ [2023-02-21 10:02:57.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | obproxy | [2023-02-21 10:02:57.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 10:02:57.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | ip | port | prometheus_port | status | [2023-02-21 10:02:57.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 10:02:57.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | 10.253.208.63 | 2883 | 2884 | active | [2023-02-21 10:02:57.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 10:02:57.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] obclient -h10.253.208.63 -P2883 -uroot -Doceanbase -A [2023-02-21 10:02:57.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 10:02:57.896] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export display [2023-02-21 10:02:57.897] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call obagent-py_script_display-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:02:57.897] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import display [2023-02-21 10:02:57.897] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 10:02:57.898] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.65:8088/metrics/stat" [2023-02-21 10:02:57.937] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:57.937] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.67:8088/metrics/stat" [2023-02-21 10:02:57.993] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:57.994] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.172:8088/metrics/stat" [2023-02-21 10:02:58.045] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +----------------------------------------------------+ [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | obagent | [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | ip | server_port | pprof_port | status | [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | 10.253.208.65 | 8088 | 8089 | active | [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | 10.253.208.67 | 8088 | 8089 | active | [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | 10.253.208.172 | 8088 | 8089 | active | [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export display [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:02:58.048] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - import display [2023-02-21 10:02:58.050] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 10:02:58.050] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 10:02:58.054] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +------------------------------------------------------+ [2023-02-21 10:02:58.054] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | prometheus | [2023-02-21 10:02:58.054] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 10:02:58.054] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 10:02:58.055] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 10:02:58.055] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] | http://10.253.208.63:9090 | | | active | [2023-02-21 10:02:58.055] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 10:02:58.055] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 10:02:58.055] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - export display [2023-02-21 10:02:58.055] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 10:02:58.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 10:02:58.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 10:02:58.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 10:02:58.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 10:02:58.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 10:02:58.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 10:02:58.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 10:02:58.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 10:02:58.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 10:02:58.056] [b5e78812-b18b-11ed-b120-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 10:19:07.983] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 10:19:07.984] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 10:19:07.984] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 10:19:07.985] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 10:19:07.985] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None} [2023-02-21 10:19:07.985] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 10:19:07.985] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 10:19:07.985] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 10:19:07.986] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 10:19:07.986] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 10:19:08.005] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Check the deploy status [2023-02-21 10:19:08.006] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 10:19:08.007] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 10:19:08.007] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:08.008] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 10:19:08.008] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 10:19:08.012] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:08.012] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 10:19:08.016] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:08.017] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 10:19:08.021] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:08.021] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 10:19:08.025] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:08.025] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 10:19:08.138] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 10:19:08.218] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [INFO] Search plugins [2023-02-21 10:19:08.219] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 10:19:08.219] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 10:19:08.219] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 10:19:08.221] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:19:08.221] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:09.449] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 10:19:09.450] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:19:09.450] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:09.749] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 10:19:09.749] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 10:19:09.749] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:09.929] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 10:19:09.929] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 10:19:09.929] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:09.969] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 10:19:09.970] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 10:19:09.970] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:10.029] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Searching stop plugin for components ... [2023-02-21 10:19:10.030] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:10.031] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:19:10.031] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:10.031] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:19:10.031] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Searching stop plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:10.031] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_stop-0.1 for obagent-1.2.0 [2023-02-21 10:19:10.032] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Searching stop plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:10.032] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_stop-2.37.1 for prometheus-2.37.1 [2023-02-21 10:19:10.032] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Searching stop plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:10.032] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_stop-7.5.17 for grafana-7.5.17 [2023-02-21 10:19:10.159] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 10:19:11.210] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:11.210] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 10:19:11.211] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 10:19:11.212] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [INFO] Stop observer [2023-02-21 10:19:11.213] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:11.252] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:11.252] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ps uax | egrep " 105271 " | grep -v grep [2023-02-21 10:19:11.357] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:11.357] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid:105271] stopping ... [2023-02-21 10:19:11.357] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: kill -9 105271 [2023-02-21 10:19:11.423] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:11.423] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:11.460] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:11.461] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ps uax | egrep " 12704 " | grep -v grep [2023-02-21 10:19:11.560] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:11.560] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid:12704] stopping ... [2023-02-21 10:19:11.561] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: kill -9 12704 [2023-02-21 10:19:11.621] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:11.622] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:11.694] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:11.694] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ps uax | egrep " 195440 " | grep -v grep [2023-02-21 10:19:11.779] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:11.779] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid:195440] stopping ... [2023-02-21 10:19:11.779] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: kill -9 195440 [2023-02-21 10:19:11.845] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:12.847] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) check whether the port is released [2023-02-21 10:19:12.847] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:12.884] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:12.884] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:12.951] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:12.951] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 10:19:13.010] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:13.010] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer is stopped [2023-02-21 10:19:13.011] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) check whether the port is released [2023-02-21 10:19:13.011] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:13.040] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:13.040] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:13.115] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:13.116] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 10:19:13.177] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:13.177] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer is stopped [2023-02-21 10:19:13.178] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) check whether the port is released [2023-02-21 10:19:13.178] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:13.204] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:13.205] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:13.274] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:13.274] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 10:19:13.336] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:13.336] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer is stopped [2023-02-21 10:19:13.429] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 10:19:13.429] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 10:19:13.429] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:13.430] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 10:19:13.432] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 10:19:13.433] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [INFO] Stop obproxy [2023-02-21 10:19:13.434] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:19:13.458] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:13.458] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/219500 [2023-02-21 10:19:13.520] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:13.520] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/219500/fd [2023-02-21 10:19:13.580] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:13.581] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid:219500] stopping ... [2023-02-21 10:19:13.581] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid | xargs kill -9; kill -9 -219500 [2023-02-21 10:19:13.642] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:14.643] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 10:19:14.643] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:14.667] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:14.668] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:14.730] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:14.731] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -f /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:19:14.790] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:14.790] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy is stopped [2023-02-21 10:19:14.868] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 10:19:14.868] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 10:19:14.869] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Call obagent-py_script_stop-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:14.869] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 10:19:14.870] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 10:19:14.870] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [INFO] Stop obagent [2023-02-21 10:19:14.873] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:19:14.895] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:14.895] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/106126 [2023-02-21 10:19:14.955] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:14.955] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent[pid:106126] stopping ... [2023-02-21 10:19:14.955] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: kill -9 106126 [2023-02-21 10:19:15.015] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:15.015] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:19:15.037] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:15.038] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/13524 [2023-02-21 10:19:15.098] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:15.099] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent[pid:13524] stopping ... [2023-02-21 10:19:15.099] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: kill -9 13524 [2023-02-21 10:19:15.160] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:15.160] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:19:15.189] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:15.189] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/196306 [2023-02-21 10:19:15.255] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:15.255] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent[pid:196306] stopping ... [2023-02-21 10:19:15.255] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: kill -9 196306 [2023-02-21 10:19:15.318] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.320] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) check whether the port is released [2023-02-21 10:19:16.320] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:16.348] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.349] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:16.414] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.415] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:19:16.475] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.476] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent is stopped [2023-02-21 10:19:16.476] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) check whether the port is released [2023-02-21 10:19:16.476] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:16.502] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.502] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:16.567] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.568] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:19:16.630] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.630] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent is stopped [2023-02-21 10:19:16.630] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) check whether the port is released [2023-02-21 10:19:16.630] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:16.659] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.660] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:16.733] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.733] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:19:16.797] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.798] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent is stopped [2023-02-21 10:19:16.826] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 10:19:16.826] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 10:19:16.826] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_stop-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:16.826] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 10:19:16.828] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 10:19:16.828] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [INFO] Stop prometheus [2023-02-21 10:19:16.830] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 10:19:16.852] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.853] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/219924 [2023-02-21 10:19:16.914] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.914] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/219924/fd [2023-02-21 10:19:16.975] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:16.976] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus[pid:219924] stopping... [2023-02-21 10:19:16.976] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheusd.pid | xargs kill -9; kill -9 219924 [2023-02-21 10:19:17.038] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:18.039] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 10:19:18.039] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:18.068] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:18.068] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -f /data/obdata/prometheus/run/prometheus.pid [2023-02-21 10:19:18.132] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:18.132] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus is stopped [2023-02-21 10:19:18.263] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 10:19:18.264] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 10:19:18.264] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Call grafana-py_script_stop-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:18.264] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 10:19:18.266] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 10:19:18.266] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [INFO] Stop grafana [2023-02-21 10:19:18.267] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 10:19:18.288] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:18.289] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/220141 [2023-02-21 10:19:18.351] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:18.351] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/220141/fd [2023-02-21 10:19:18.412] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:18.413] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana[pid:220141] stopping... [2023-02-21 10:19:18.413] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: kill -9 220141 [2023-02-21 10:19:18.474] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:19.476] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 10:19:19.477] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:19.506] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:19.506] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana is stopped [2023-02-21 10:19:19.571] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 10:19:19.571] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 10:19:19.571] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - Set observer deploy status to stopped [2023-02-21 10:19:19.571] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 10:19:19.580] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [INFO] observer stopped [2023-02-21 10:19:19.580] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 10:19:19.580] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 10:19:19.580] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 10:19:19.581] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 10:19:19.581] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 10:19:19.581] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 10:19:19.581] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 10:19:19.581] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 10:19:19.581] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 10:19:19.581] [1edffc76-b18e-11ed-87d1-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 10:19:38.148] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 10:19:38.149] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 10:19:38.149] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 10:19:38.149] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 10:19:38.149] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2023-02-21 10:19:38.149] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 10:19:38.149] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 10:19:38.149] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 10:19:38.150] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 10:19:38.150] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 10:19:38.170] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 10:19:38.171] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 10:19:38.172] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 10:19:38.172] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:38.172] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: 4.0.0.0, tag: 1d56dc742f5f05a2d15797d291b51a94019e728d, release: None, package_hash: None [2023-02-21 10:19:38.173] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 10:19:38.173] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 10:19:38.173] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2023-02-21 10:19:38.177] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:38.177] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:38.177] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: de53232a951184fad75b15884458d85e31d2f6c3, release: None, package_hash: None [2023-02-21 10:19:38.177] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 10:19:38.177] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2023-02-21 10:19:38.181] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:38.182] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:38.182] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Search repository obagent version: 1.2.0, tag: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e, release: None, package_hash: None [2023-02-21 10:19:38.182] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 10:19:38.182] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obagent [2023-02-21 10:19:38.186] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:38.186] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:38.186] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Search repository prometheus version: 2.37.1, tag: 58913c7606f05feb01bc1c6410346e5fc31cf263, release: None, package_hash: None [2023-02-21 10:19:38.186] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 10:19:38.186] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/prometheus [2023-02-21 10:19:38.190] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:38.190] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:38.190] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Search repository grafana version: 7.5.17, tag: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, release: None, package_hash: None [2023-02-21 10:19:38.190] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 10:19:38.191] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/grafana [2023-02-21 10:19:38.194] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:38.303] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 10:19:38.376] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Search plugins [2023-02-21 10:19:38.377] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start_check plugin for components ... [2023-02-21 10:19:38.378] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:38.378] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 10:19:38.379] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:19:38.379] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:38.380] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:19:38.380] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:38.380] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start_check-1.1.1 for obagent-1.2.0 [2023-02-21 10:19:38.380] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start_check plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:38.380] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1 [2023-02-21 10:19:38.380] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start_check plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:38.381] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start_check-7.5.17 for grafana-7.5.17 [2023-02-21 10:19:38.381] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 10:19:38.381] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:38.382] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:19:38.382] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:38.382] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:19:38.382] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:38.382] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 10:19:38.383] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:38.383] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 10:19:38.383] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:38.383] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 10:19:38.383] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 10:19:38.383] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:38.384] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:19:38.384] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:38.384] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:19:38.384] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:38.385] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 10:19:38.385] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:38.385] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 10:19:38.385] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:38.385] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 10:19:38.385] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 10:19:38.385] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:38.386] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:19:38.386] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:38.387] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:19:38.387] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:38.387] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 10:19:38.387] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:38.387] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 10:19:38.388] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:38.388] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 10:19:38.388] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 10:19:38.388] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:38.389] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:19:38.389] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:38.389] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:19:38.389] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:38.389] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 10:19:38.389] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:38.390] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 10:19:38.390] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:38.390] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 10:19:38.508] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 10:19:39.684] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 10:19:39.687] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 10:19:39.687] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 10:19:39.688] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:19:39.688] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:40.445] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 10:19:40.446] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:19:40.446] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:40.611] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 10:19:40.612] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 10:19:40.612] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:40.714] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 10:19:40.714] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 10:19:40.714] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:40.736] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 10:19:40.737] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 10:19:40.737] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:40.844] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:40.845] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 10:19:40.848] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 10:19:40.849] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Check before start observer [2023-02-21 10:19:40.850] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:40.887] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:40.887] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:19:40.887] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:40.888] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) port check [2023-02-21 10:19:40.888] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:40.957] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:40.957] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:41.024] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.025] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /topevery/obdata/sstable/block_file [2023-02-21 10:19:41.087] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.088] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:41.120] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:41.120] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:19:41.120] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:41.120] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) port check [2023-02-21 10:19:41.121] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:41.184] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.184] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:41.248] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.249] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /data/obdata/sstable/block_file [2023-02-21 10:19:41.313] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.314] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:41.338] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:41.339] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:19:41.339] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:41.339] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) port check [2023-02-21 10:19:41.339] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:41.405] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.406] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:41.472] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.472] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /data/obdata/sstable/block_file [2023-02-21 10:19:41.536] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.536] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 10:19:41.561] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.562] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ulimit -a [2023-02-21 10:19:41.623] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.624] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.65) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:19:41.624] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/meminfo [2023-02-21 10:19:41.685] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.686] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [WARNING] [WARN] OBD-2000: (10.253.208.65) not enough memory. (Free: 5.0G, Need: 10.0G) [2023-02-21 10:19:41.686] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: df --block-size=1024 [2023-02-21 10:19:41.751] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.752] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 51118489600, 'need': 0}, '/dev': {'total': 20979048448, 'avail': 20979048448, 'need': 0}, '/dev/shm': {'total': 20991266816, 'avail': 20991266816, 'need': 0}, '/run': {'total': 20991266816, 'avail': 20006989824, 'need': 0}, '/sys/fs/cgroup': {'total': 20991266816, 'avail': 20991266816, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 889667584, 'need': 0}, '/home': {'total': 44127686656, 'avail': 42828767232, 'need': 0}, '/topevery': {'total': 2113643364352, 'avail': 660665995264, 'need': 0}, '/run/user/0': {'total': 4198256640, 'avail': 4198256640, 'need': 0}, '/run/user/1001': {'total': 4198256640, 'avail': 4198256640, 'need': 0}} [2023-02-21 10:19:41.753] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 10:19:41.777] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.777] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ulimit -a [2023-02-21 10:19:41.841] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.842] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.67) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:19:41.842] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/meminfo [2023-02-21 10:19:41.904] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.905] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: df --block-size=1024 [2023-02-21 10:19:41.970] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.971] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 50949328896, 'need': 0}, '/dev': {'total': 8296525824, 'avail': 8296525824, 'need': 0}, '/dev/shm': {'total': 8308740096, 'avail': 8308736000, 'need': 0}, '/run': {'total': 8308740096, 'avail': 7425159168, 'need': 0}, '/sys/fs/cgroup': {'total': 8308740096, 'avail': 8308740096, 'need': 0}, '/data': {'total': 211242950656, 'avail': 60839272448, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 889667584, 'need': 0}, '/home': {'total': 44127686656, 'avail': 42820583424, 'need': 0}, '/run/user/0': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1001': {'total': 1661751296, 'avail': 1661751296, 'need': 0}} [2023-02-21 10:19:41.971] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 10:19:41.998] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:41.998] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ulimit -a [2023-02-21 10:19:42.062] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.062] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.172) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:19:42.062] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/meminfo [2023-02-21 10:19:42.126] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.127] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: df --block-size=1024 [2023-02-21 10:19:42.189] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.190] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 41979199488, 'need': 0}, '/dev': {'total': 8291450880, 'avail': 8291450880, 'need': 0}, '/dev/shm': {'total': 8308744192, 'avail': 8308715520, 'need': 0}, '/run': {'total': 8308744192, 'avail': 8079097856, 'need': 0}, '/sys/fs/cgroup': {'total': 8308744192, 'avail': 8308744192, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 844517376, 'need': 0}, '/home': {'total': 48420556800, 'avail': 47102480384, 'need': 0}, '/data': {'total': 316924559360, 'avail': 161148342272, 'need': 0}, '/run/user/0': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1002': {'total': 1661751296, 'avail': 1661751296, 'need': 0}} [2023-02-21 10:19:42.190] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: date +%s%N [2023-02-21 10:19:42.213] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.214] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.65 time delta -1.392822265625 [2023-02-21 10:19:42.214] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: date +%s%N [2023-02-21 10:19:42.237] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.237] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.67 time delta -2.0517578125 [2023-02-21 10:19:42.237] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: date +%s%N [2023-02-21 10:19:42.260] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.261] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.172 time delta -2.329833984375 [2023-02-21 10:19:42.284] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.65) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:19:42.284] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] [WARN] OBD-2000: (10.253.208.65) not enough memory. (Free: 5.0G, Need: 10.0G) [2023-02-21 10:19:42.285] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.67) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:19:42.285] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.172) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 10:19:42.285] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] [2023-02-21 10:19:42.285] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 10:19:42.285] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 10:19:42.285] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:19:42.285] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 10:19:42.287] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 10:19:42.287] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Check before start obproxy [2023-02-21 10:19:42.288] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:19:42.317] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:42.317] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 10:19:42.318] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:42.318] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 10:19:42.319] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:42.385] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.385] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:42.452] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.550] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 10:19:42.550] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 10:19:42.550] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start_check-1.1.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:19:42.550] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 10:19:42.551] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 10:19:42.552] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Check before start obagent [2023-02-21 10:19:42.552] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:19:42.575] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:42.576] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 10:19:42.576] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:42.576] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) port check [2023-02-21 10:19:42.576] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:42.644] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.645] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:42.714] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.714] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:19:42.735] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:42.736] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 10:19:42.736] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:42.736] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) port check [2023-02-21 10:19:42.736] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:42.798] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.798] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:42.861] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.862] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:19:42.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:42.891] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 10:19:42.891] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:42.891] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) port check [2023-02-21 10:19:42.891] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:42.964] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:42.965] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:43.038] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:43.075] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 10:19:43.075] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 10:19:43.075] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:19:43.075] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 10:19:43.077] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 10:19:43.078] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Check before start prometheus [2023-02-21 10:19:43.079] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 10:19:43.102] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:43.103] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /data/obdata/prometheus/run/prometheus.pid: 没有那个文件或目录 [2023-02-21 10:19:43.103] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:43.103] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 10:19:43.103] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:43.169] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:43.210] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 10:19:43.210] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 10:19:43.210] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start_check-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:19:43.210] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 10:19:43.212] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 10:19:43.212] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Check before start grafana [2023-02-21 10:19:43.213] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 10:19:43.237] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:43.238] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/220141 [2023-02-21 10:19:43.300] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 10:19:43.300] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/220141: 没有那个文件或目录 [2023-02-21 10:19:43.300] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:43.300] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 10:19:43.301] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:19:43.367] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:43.474] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 10:19:43.474] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 10:19:43.474] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:43.474] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import start [2023-02-21 10:19:43.477] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 10:19:43.478] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Start observer [2023-02-21 10:19:43.479] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:43.505] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:43.505] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:19:43.505] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:43.505] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) start command construction [2023-02-21 10:19:43.505] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:43.525] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:43.525] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:19:43.525] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:43.526] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) start command construction [2023-02-21 10:19:43.526] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:43.549] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:19:43.550] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 10:19:43.550] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:19:43.550] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) start command construction [2023-02-21 10:19:43.550] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- starting server1(10.253.208.65) observer [2023-02-21 10:19:43.551] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 10:19:43.551] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone1' -n 'obcluster' -c 1 -d '/topevery/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 10:19:43.729] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:43.730] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 delete env LD_LIBRARY_PATH [2023-02-21 10:19:43.730] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- starting server2(10.253.208.67) observer [2023-02-21 10:19:43.731] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 10:19:43.731] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone2' -n 'obcluster' -c 1 -d '/data/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 10:19:43.893] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:43.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 delete env LD_LIBRARY_PATH [2023-02-21 10:19:43.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- starting server3(10.253.208.172) observer [2023-02-21 10:19:43.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 10:19:43.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone3' -n 'obcluster' -c 1 -d '/data/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 10:19:44.931] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:44.932] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 delete env LD_LIBRARY_PATH [2023-02-21 10:19:45.044] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] observer program health check [2023-02-21 10:19:48.047] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 10:19:48.048] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:48.070] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:48.070] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/108336 [2023-02-21 10:19:48.135] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:48.135] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid: 108336] started [2023-02-21 10:19:48.135] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 10:19:48.135] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:48.168] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:48.168] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/15656 [2023-02-21 10:19:48.244] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:48.244] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid: 15656] started [2023-02-21 10:19:48.244] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 10:19:48.244] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:19:48.290] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:48.290] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/198942 [2023-02-21 10:19:48.398] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:19:48.399] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid: 198942] started [2023-02-21 10:19:48.434] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 10:19:48.434] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export start [2023-02-21 10:19:48.434] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:48.435] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 10:19:48.479] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 10:19:48.479] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Connect to observer [2023-02-21 10:19:48.480] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 10:19:48.872] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 10:19:48.872] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 10:19:48.872] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 10:19:48.873] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:19:48.873] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 10:19:48.875] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 10:19:48.875] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 10:19:58.885] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 4012:Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. [2023-02-21 10:19:58.885] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- execute sql: alter system bootstrap REGION "sys_region" ZONE "zone1" SERVER "10.253.208.65:2882",REGION "sys_region" ZONE "zone2" SERVER "10.253.208.67:2882",REGION "sys_region" ZONE "zone3" SERVER "10.253.208.172:2882" [2023-02-21 10:19:58.889] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 10:19:58.889] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "core.py", line 1446, in start_cluster [2023-02-21 10:19:58.889] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "core.py", line 1552, in _start_cluster [2023-02-21 10:19:58.889] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 10:19:58.889] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 10:19:58.889] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/bootstrap.py", line 87, in bootstrap [2023-02-21 10:19:58.889] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] cursor.execute(sql) [2023-02-21 10:19:58.889] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] result.read() [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 10:19:58.890] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 10:19:58.891] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (4015, 'System error') [2023-02-21 10:19:58.891] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] [2023-02-21 10:19:58.891] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2023-02-21 10:19:58.892] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 10:20:02.778] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 10:20:02.778] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 10:20:02.826] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:20:02.827] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import start [2023-02-21 10:20:02.829] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 10:20:02.831] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Start obproxy [2023-02-21 10:20:02.831] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/obproxy/etc/obproxy_config.bin [2023-02-21 10:20:02.855] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:02.855] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 10:20:02.855] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:20:02.915] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:02.915] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 10:20:02.915] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:02.915] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- starting 10.253.208.63 obproxy [2023-02-21 10:20:02.916] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/obproxy/lib:' [2023-02-21 10:20:02.916] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/obproxy; /data/obdata/obproxy/bin/obproxy -o obproxy_sys_password='',enable_strict_kernel_release=False,enable_cluster_checkout=False,skip_proxy_sys_private_check=True --listen_port 2883 --prometheus_listen_port 2884 --rs_list '10.253.208.65:2881;10.253.208.67:2881;10.253.208.172:2881' --cluster_name 'obcluster' [2023-02-21 10:20:03.115] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:03.116] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 delete env LD_LIBRARY_PATH [2023-02-21 10:20:03.116] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/obproxy/bin/obproxy -o obproxy_sys_password=,enable_strict_kernel_release=False,enable_cluster_checkout=False,skip_proxy_sys_private_check=True --listen_port 2883 --prometheus_listen_port 2884 --rs_list 10.253.208.65:2881;10.253.208.67:2881;10.253.208.172:2881 --cluster_name obcluster$' | grep -v grep | awk '{print $2}' > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:20:03.214] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:03.225] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] obproxy program health check [2023-02-21 10:20:03.225] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:03.225] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:20:03.275] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:03.276] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:03.341] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:03.341] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 19 [2023-02-21 10:20:04.343] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:04.343] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:20:04.364] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:04.364] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:04.429] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:04.429] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 18 [2023-02-21 10:20:05.431] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:05.431] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:20:05.452] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:05.452] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:05.516] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:05.516] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 2104316871 [2023-02-21 10:20:05.516] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:05.516] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/226994/fd/ |grep -E 'socket:\[(2104316871)\]' [2023-02-21 10:20:05.578] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:05.579] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 10:20:05.640] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 10:20:05.640] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/219478: 没有那个文件或目录 [2023-02-21 10:20:05.640] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:05.640] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: echo 226994 > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:20:05.699] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:05.781] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 10:20:05.781] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/obproxy && rm -fr /data/obdata/obproxy/obproxyd.sh [2023-02-21 10:20:05.803] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:05.803] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /data/obdata/obproxy/obproxyd.sh [2023-02-21 10:20:05.847] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/obproxy/obproxyd.sh [2023-02-21 10:20:05.868] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:05.868] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash /data/obdata/obproxy/obproxyd.sh /data/obdata/obproxy 10.253.208.63 2883 [2023-02-21 10:20:05.935] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:06.936] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:06.937] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:20:06.958] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:06.959] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:07.024] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:07.025] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 16 [2023-02-21 10:20:08.026] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:08.026] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:20:08.053] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:08.053] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:08.118] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:08.118] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 15 [2023-02-21 10:20:09.119] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:09.120] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:20:09.140] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:09.140] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:09.202] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:09.203] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 2104321073 [2023-02-21 10:20:09.203] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:09.203] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/227241/fd/ |grep -E 'socket:\[(2104321073)\]' [2023-02-21 10:20:09.266] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:09.266] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 10:20:09.330] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:09.331] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid: 227241] started [2023-02-21 10:20:09.354] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 10:20:09.354] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export start [2023-02-21 10:20:09.354] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:20:09.354] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 10:20:09.355] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 10:20:09.356] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Connect to obproxy [2023-02-21 10:20:09.356] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- connect 10.253.208.63 -P2883 -uroot@proxysys -p [2023-02-21 10:20:09.489] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 10:20:09.489] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 10:20:09.489] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 10:20:09.490] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:20:09.490] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 10:20:09.491] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 10:20:09.491] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set observer_sys_password = [2023-02-21 10:20:09.514] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set obproxy_sys_password = [2023-02-21 10:20:09.533] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 10:20:09.533] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 10:20:09.621] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:20:09.621] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import start [2023-02-21 10:20:09.703] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 10:20:09.704] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Start obagent [2023-02-21 10:20:09.740] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:20:09.768] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:09.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 10:20:09.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:09.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:09.854] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 10:20:09.854] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:09.875] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:09.875] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp1ucwberd.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:09.920] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:09.941] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:09.944] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:09.944] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:10.005] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:10.005] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpxwzu1t_z.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:10.050] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:10.071] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:10.075] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:10.075] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:10.133] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:10.133] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpl0d4bsqe.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:10.178] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:10.200] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:10.203] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 10:20:10.203] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:20:10.263] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:10.263] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpwtsjg5ut.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:20:10.307] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:20:10.328] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:10.330] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:10.331] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:10.391] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:10.392] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpves52iux.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:10.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:10.458] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:10.461] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:10.462] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:10.524] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:10.524] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpc9mlp0rl.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:10.569] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:10.593] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:10.596] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:10.597] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:10.659] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:10.660] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpe8pgw9tb.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:10.709] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:10.731] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:10.738] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:10.738] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:10.798] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:10.798] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpkbgbi1qq.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:10.843] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:10.867] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:10.870] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:10.871] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:10.934] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:10.934] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpjnqvyp6f.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:10.979] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:11.002] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:11.008] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:20:11.065] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:11.065] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp2ek22_f2.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:20:11.110] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:20:11.131] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:11.134] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:20:11.191] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:11.192] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:20:11.215] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:11.215] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 10:20:11.216] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:11.217] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:11.302] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 10:20:11.302] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:11.329] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:11.329] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpmkpxtr7f.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:11.380] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:11.402] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:11.405] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:11.405] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:11.464] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:11.464] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpfo_636wy.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:11.514] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:11.534] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:11.538] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:11.539] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:11.596] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:11.596] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmppvn5uzlq.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:11.644] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:11.669] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:11.672] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 10:20:11.673] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:20:11.731] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:11.732] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp_haoo74k.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:20:11.779] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:20:11.806] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:11.809] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:11.809] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:11.872] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:11.873] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpdz1yfmt3.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:11.920] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:11.940] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:11.943] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:11.944] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:12.005] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:12.005] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp1jedorga.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:12.055] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:12.078] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:12.081] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:12.082] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:12.147] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:12.148] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp1c0jtads.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:12.203] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:12.228] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:12.234] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:12.234] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:12.293] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:12.293] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp2sfmdjmc.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:12.342] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:12.362] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:12.366] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:12.366] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:12.425] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:12.425] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp1zlv5uur.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:12.472] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:12.493] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:12.499] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:20:12.558] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:12.558] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmphe0tcajc.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:20:12.607] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:20:12.630] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:12.633] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:20:12.705] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:12.706] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:20:12.739] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:12.740] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 10:20:12.740] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:12.741] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:12.838] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 10:20:12.838] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:12.866] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:12.866] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpk1euyg32.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:12.911] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 10:20:12.937] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:12.941] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:12.941] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:13.004] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:13.005] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp0fmpj16y.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:13.050] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 10:20:13.080] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:13.083] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:13.084] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:13.147] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:13.148] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp9efcgu3q.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:13.193] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 10:20:13.224] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:13.227] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 10:20:13.227] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:20:13.289] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:13.290] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp9jfs5u9g.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:20:13.334] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 10:20:13.356] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:13.358] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:13.358] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:13.423] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:13.424] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp7d81ft2y.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:13.468] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 10:20:13.491] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:13.494] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:13.494] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:13.557] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:13.557] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpg807m4vs.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:13.603] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 10:20:13.631] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:13.635] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:13.636] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:13.701] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:13.701] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp3glcw_8g.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:13.748] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 10:20:13.777] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:13.782] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:13.783] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:13.862] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:13.863] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpwo_bdj3j.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:13.908] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 10:20:13.933] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:13.937] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:13.937] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:14.006] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:14.007] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpphkacdp2.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:14.051] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 10:20:14.083] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:14.088] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:20:14.152] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:14.153] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpe2trpj_i.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:20:14.197] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 10:20:14.220] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:14.223] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:20:14.283] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:14.407] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] obagent program health check [2023-02-21 10:20:15.409] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 10:20:15.409] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:20:15.433] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:15.433] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:15.501] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:15.502] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 10:20:15.502] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:20:15.525] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:15.525] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:15.590] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:15.590] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 10:20:15.591] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:20:15.619] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:15.620] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:15.701] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:15.702] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- start to sync target config [2023-02-21 10:20:15.711] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 10:20:15.711] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export start [2023-02-21 10:20:15.711] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call obagent-py_script_connect-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:20:15.712] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 10:20:15.712] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 10:20:15.713] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 10:20:15.713] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 10:20:15.713] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:20:15.713] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import start [2023-02-21 10:20:15.716] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 10:20:15.716] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Start promethues [2023-02-21 10:20:15.717] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/.prometheus_started [2023-02-21 10:20:15.738] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:15.739] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:20:15.799] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:15.800] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:20:15.860] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:15.893] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- write global: [2023-02-21 10:20:15.893] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] scrape_interval: 1s [2023-02-21 10:20:15.893] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] evaluation_interval: 10s [2023-02-21 10:20:15.893] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:15.893] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] rule_files: [2023-02-21 10:20:15.893] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - rules/*rules.yaml [2023-02-21 10:20:15.893] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:15.893] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] scrape_configs: [2023-02-21 10:20:15.893] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - job_name: prometheus [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] metrics_path: /metrics [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.63:9090 [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - job_name: node [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] password: root [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] metrics_path: /metrics/node/host [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - files: [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - job_name: ob_basic [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] password: root [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/basic [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 10:20:15.894] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - files: [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - job_name: ob_extra [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] password: root [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/extra [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - files: [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - job_name: agent [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] password: root [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] metrics_path: /metrics/stat [2023-02-21 10:20:15.895] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 10:20:15.896] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 10:20:15.896] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 10:20:15.896] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 10:20:15.896] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 10:20:15.896] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 10:20:15.896] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 10:20:15.896] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - files: [2023-02-21 10:20:15.896] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - targets/*.yaml to admin@10.253.208.63:22: /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:20:15.896] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:20:15.924] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:15.924] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpjo3bf0wb to /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:20:15.970] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/prometheus/prometheus.yaml [2023-02-21 10:20:15.993] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:15.996] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 10:20:16.056] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:16.057] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 10:20:16.101] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 10:20:16.124] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:16.124] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle --start-only [2023-02-21 10:20:16.228] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:16.228] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheus.pid` && ls /proc/$pid [2023-02-21 10:20:16.294] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:17.372] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] prometheus program health check [2023-02-21 10:20:17.373] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:17.373] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 10:20:17.398] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:17.504] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 10:20:17.504] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export start [2023-02-21 10:20:17.504] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:20:17.505] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 10:20:17.506] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 10:20:17.507] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Connect to Prometheus [2023-02-21 10:20:17.509] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- connect prometheus (10.253.208.63:9090 by user None) [2023-02-21 10:20:17.509] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 10:20:17.639] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 10:20:17.639] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 10:20:17.640] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 10:20:17.640] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:20:17.641] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 10:20:17.641] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 10:20:17.642] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: touch /data/obdata/prometheus/.prometheus_started [2023-02-21 10:20:17.664] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:17.664] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 10:20:17.664] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 10:20:17.771] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:20:17.772] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import start [2023-02-21 10:20:17.775] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 10:20:17.775] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Start grafana [2023-02-21 10:20:17.777] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate obd-grafana ini file [2023-02-21 10:20:17.778] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf && rm -fr /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 10:20:17.804] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:17.804] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpco0fquag.ini to /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 10:20:17.850] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 10:20:17.873] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:17.875] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate datasources yaml [2023-02-21 10:20:17.877] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 10:20:17.878] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] datasources: [2023-02-21 10:20:17.878] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - name: OB-Prometheus [2023-02-21 10:20:17.878] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] isDefault: 'true' [2023-02-21 10:20:17.878] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] type: prometheus [2023-02-21 10:20:17.878] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] access: proxy [2023-02-21 10:20:17.878] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] editable: 'true' [2023-02-21 10:20:17.878] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] url: http://10.253.208.63:9090 to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 10:20:17.879] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/datasources && rm -fr /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 10:20:17.937] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:17.937] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmp_vhocixu to /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 10:20:17.984] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 10:20:18.007] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:18.010] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate providers yaml [2023-02-21 10:20:18.012] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 10:20:18.012] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] providers: [2023-02-21 10:20:18.012] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - name: OceanBase Metrics [2023-02-21 10:20:18.012] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] type: file [2023-02-21 10:20:18.012] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] allowUiUpdates: 'true' [2023-02-21 10:20:18.012] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] options: [2023-02-21 10:20:18.012] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] path: /data/obdata/grafana/conf/provisioning/dashboards/templates to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 10:20:18.013] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 10:20:18.069] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:18.069] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send /tmp/tmpdjrz5ot0 to /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 10:20:18.115] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 10:20:18.140] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 10:20:18.143] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 10:20:18.222] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:18.222] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/grafana; bash -c '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid > /data/obdata/grafana/data/log/grafana-console.log 2>&1 &' [2023-02-21 10:20:18.286] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:18.286] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 10:20:18.369] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:19.434] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] grafana program health check [2023-02-21 10:20:19.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:19.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:19.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:19.478] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:19.478] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:19.548] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:19.548] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:19.548] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:19.548] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 19 [2023-02-21 10:20:20.549] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:20.549] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:20.549] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:20.577] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:20.578] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:20.639] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:20.640] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:20.640] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:20.640] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 18 [2023-02-21 10:20:21.641] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:21.642] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:21.642] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:21.669] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:21.670] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:21.732] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:21.732] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:21.732] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:21.732] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 17 [2023-02-21 10:20:22.733] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:22.733] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:22.734] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:22.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:22.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:22.828] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:22.828] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:22.828] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:22.828] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 16 [2023-02-21 10:20:23.830] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:23.830] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:23.830] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:23.858] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:23.858] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:23.919] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:23.920] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:23.920] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:23.920] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 15 [2023-02-21 10:20:24.921] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:24.921] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:24.921] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:24.947] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:24.947] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:25.008] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:25.008] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:25.008] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:25.008] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 14 [2023-02-21 10:20:26.010] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:26.010] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:26.010] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:26.037] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:26.038] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:26.099] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:26.099] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:26.099] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:26.099] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 13 [2023-02-21 10:20:27.101] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:27.101] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:27.101] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:27.130] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:27.131] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:27.193] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:27.193] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:27.193] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:27.194] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 12 [2023-02-21 10:20:28.195] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:28.195] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:28.195] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:28.222] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:28.223] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:28.287] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:28.288] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:28.288] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:28.288] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 11 [2023-02-21 10:20:29.289] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:29.289] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:29.289] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:29.319] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:29.320] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:29.386] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:29.386] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:29.386] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:29.386] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 10 [2023-02-21 10:20:30.387] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:30.387] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:30.388] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:30.418] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:30.418] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:30.484] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:30.484] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:30.484] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:30.485] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 9 [2023-02-21 10:20:31.485] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:31.486] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:31.486] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:31.514] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:31.514] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:31.577] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:31.577] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:31.577] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:31.577] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 8 [2023-02-21 10:20:32.578] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:32.579] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:32.579] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:32.607] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:32.608] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:32.671] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:32.671] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:32.671] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:32.671] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 7 [2023-02-21 10:20:33.673] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:33.673] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:33.673] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:33.700] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:33.701] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:33.762] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:33.762] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:33.763] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:33.763] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 6 [2023-02-21 10:20:34.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:34.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:34.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:34.792] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:34.793] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:34.855] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:34.856] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:34.856] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:34.856] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 5 [2023-02-21 10:20:35.857] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:35.857] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:35.858] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:35.883] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:35.884] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:35.945] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:35.945] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:35.946] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:35.946] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 4 [2023-02-21 10:20:36.947] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:36.947] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:36.947] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:36.972] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:36.973] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:37.033] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:37.033] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:37.033] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:37.033] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 3 [2023-02-21 10:20:38.034] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:38.035] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:38.035] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:38.061] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:38.061] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:38.122] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:38.122] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:38.122] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:38.123] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 2 [2023-02-21 10:20:39.124] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:39.124] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:39.124] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:39.149] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:39.149] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:39.209] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:39.209] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:39.209] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:39.209] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 1 [2023-02-21 10:20:40.210] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 10:20:40.211] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fde15ce4518>: ['']} [2023-02-21 10:20:40.211] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:20:40.235] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:40.235] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104312954)\]' [2023-02-21 10:20:40.297] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 10:20:40.297] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 10:20:40.297] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] [2023-02-21 10:20:40.297] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 0 [2023-02-21 10:20:40.426] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [WARNING] [WARN] failed to start 10.253.208.63 grafana [2023-02-21 10:20:40.427] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 10:20:40.427] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export start [2023-02-21 10:20:40.427] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [ERROR] [ERROR] grafana start failed [2023-02-21 10:20:40.427] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:20:40.427] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import display [2023-02-21 10:20:40.428] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 10:20:40.429] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] Wait for observer init [2023-02-21 10:20:40.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 10:20:40.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | observer | [2023-02-21 10:20:40.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:20:40.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 10:20:40.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:20:40.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 10:20:40.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 10:20:40.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 10:20:40.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:20:40.436] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 10:20:40.560] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 10:20:40.560] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | observer | [2023-02-21 10:20:40.560] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:20:40.560] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 10:20:40.560] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:20:40.560] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 10:20:40.560] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 10:20:40.561] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 10:20:40.561] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 10:20:40.561] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 10:20:40.561] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] [2023-02-21 10:20:40.561] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 10:20:40.561] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export display [2023-02-21 10:20:40.561] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:20:40.561] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import display [2023-02-21 10:20:40.562] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 10:20:40.572] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +-------------------------------------------------+ [2023-02-21 10:20:40.572] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | obproxy | [2023-02-21 10:20:40.572] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 10:20:40.573] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | ip | port | prometheus_port | status | [2023-02-21 10:20:40.573] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 10:20:40.573] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | 10.253.208.63 | 2883 | 2884 | active | [2023-02-21 10:20:40.573] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 10:20:40.573] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] obclient -h10.253.208.63 -P2883 -uroot -Doceanbase -A [2023-02-21 10:20:40.573] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 10:20:40.573] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export display [2023-02-21 10:20:40.573] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call obagent-py_script_display-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:20:40.573] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import display [2023-02-21 10:20:40.574] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 10:20:40.574] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.65:8088/metrics/stat" [2023-02-21 10:20:40.619] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:40.619] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.67:8088/metrics/stat" [2023-02-21 10:20:40.653] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:40.654] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.172:8088/metrics/stat" [2023-02-21 10:20:40.762] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +----------------------------------------------------+ [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | obagent | [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | ip | server_port | pprof_port | status | [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | 10.253.208.65 | 8088 | 8089 | active | [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | 10.253.208.67 | 8088 | 8089 | active | [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | 10.253.208.172 | 8088 | 8089 | active | [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export display [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:20:40.764] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - import display [2023-02-21 10:20:40.765] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 10:20:40.766] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 10:20:40.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +------------------------------------------------------+ [2023-02-21 10:20:40.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | prometheus | [2023-02-21 10:20:40.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 10:20:40.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 10:20:40.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 10:20:40.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] | http://10.253.208.63:9090 | | | active | [2023-02-21 10:20:40.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 10:20:40.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 10:20:40.769] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - export display [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 10:20:40.770] [30dac848-b18e-11ed-a4a7-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 10:39:53.886] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 10:39:53.887] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 10:39:53.887] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 10:39:53.887] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 10:39:53.887] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - opts: {} [2023-02-21 10:39:53.887] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 10:39:53.887] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 10:39:53.888] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 10:39:53.888] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 10:39:53.888] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 10:39:53.986] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - allow include file not exists [2023-02-21 10:39:53.986] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Load /home/admin/.obd/cluster/observer/config.yaml [2023-02-21 10:39:53.986] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 10:39:53.987] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:39:53.987] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 10:39:53.987] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 10:39:53.991] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:39:53.991] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 10:39:53.996] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:39:53.996] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 10:39:54.000] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:39:54.001] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 10:39:54.005] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:39:54.005] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 10:39:54.009] [057d99de-b191-11ed-afd3-fa163e9e21e4] [INFO] Search param plugin and load [2023-02-21 10:39:54.010] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:39:54.010] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 10:39:54.012] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:39:55.240] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:39:55.241] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:39:55.540] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Search param plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:39:55.541] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:39:55.719] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:39:55.719] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:39:55.759] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Search param plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:39:55.759] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:39:55.948] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Get environment variable EDITOR=vi [2023-02-21 10:39:55.949] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Create tmp yaml file [2023-02-21 10:39:55.956] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - vi /tmp/tmp_28wuha2.yaml [2023-02-21 10:41:17.160] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Load /tmp/tmp_28wuha2.yaml [2023-02-21 10:41:17.202] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Configure component change check [2023-02-21 10:41:17.203] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Information check for the configuration component. [2023-02-21 10:41:17.203] [057d99de-b191-11ed-afd3-fa163e9e21e4] [INFO] Search param plugin and load [2023-02-21 10:41:17.335] [057d99de-b191-11ed-afd3-fa163e9e21e4] [INFO] Parameter check [2023-02-21 10:41:17.337] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - server1(10.253.208.65) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 10:41:17.337] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - server2(10.253.208.67) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 10:41:17.338] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - server3(10.253.208.172) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 10:41:17.338] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - 10.253.208.63 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 param check [2023-02-21 10:41:17.339] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - server1(10.253.208.65) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 10:41:17.339] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - server2(10.253.208.67) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 10:41:17.339] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - server3(10.253.208.172) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 10:41:17.340] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - 10.253.208.63 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 param check [2023-02-21 10:41:17.340] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - 10.253.208.63 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 param check [2023-02-21 10:41:17.466] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - configure change check [2023-02-21 10:41:17.468] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Set deploy configuration status to DeployConfigStatus.NEED_RELOAD [2023-02-21 10:41:17.468] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - Save new configuration yaml file [2023-02-21 10:41:17.468] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 10:41:17.474] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - copy /tmp/tmp_28wuha2.yaml /home/admin/.obd/cluster/observer/tmp_config.yaml [2023-02-21 10:41:17.481] [057d99de-b191-11ed-afd3-fa163e9e21e4] [INFO] Save deploy "observer" configuration [2023-02-21 10:41:17.485] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 10:41:17.485] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 10:41:17.486] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 10:41:17.486] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 10:41:17.486] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 10:41:17.486] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 10:41:17.486] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 10:41:17.486] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 10:41:17.486] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 10:41:17.486] [057d99de-b191-11ed-afd3-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 10:41:30.097] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 10:41:30.097] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 10:41:30.097] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 10:41:30.098] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 10:41:30.098] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None} [2023-02-21 10:41:30.098] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 10:41:30.098] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 10:41:30.098] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 10:41:30.098] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 10:41:30.098] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 10:41:30.112] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Check the deploy status [2023-02-21 10:41:30.112] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 10:41:30.113] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 10:41:30.113] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:41:30.114] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 10:41:30.114] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 10:41:30.117] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:41:30.117] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 10:41:30.119] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:41:30.120] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 10:41:30.122] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:41:30.122] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 10:41:30.125] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:41:30.125] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 10:41:30.244] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 10:41:30.289] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [INFO] Search plugins [2023-02-21 10:41:30.290] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 10:41:30.290] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 10:41:30.290] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 10:41:30.291] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:41:30.291] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:41:30.956] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 10:41:30.956] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:41:30.956] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:41:31.124] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 10:41:31.125] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 10:41:31.125] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:41:31.227] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 10:41:31.227] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 10:41:31.227] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:41:31.250] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 10:41:31.250] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 10:41:31.250] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:41:31.282] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Searching stop plugin for components ... [2023-02-21 10:41:31.283] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:41:31.284] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 10:41:31.284] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:41:31.284] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 10:41:31.284] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Searching stop plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:41:31.284] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_stop-0.1 for obagent-1.2.0 [2023-02-21 10:41:31.285] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Searching stop plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:41:31.285] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_stop-2.37.1 for prometheus-2.37.1 [2023-02-21 10:41:31.285] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Searching stop plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:41:31.285] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_stop-7.5.17 for grafana-7.5.17 [2023-02-21 10:41:31.325] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 10:41:32.370] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 10:41:32.370] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 10:41:32.372] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 10:41:32.372] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [INFO] Stop observer [2023-02-21 10:41:32.373] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:41:32.474] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:32.475] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ps uax | egrep " 108336 " | grep -v grep [2023-02-21 10:41:32.580] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:32.580] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid:108336] stopping ... [2023-02-21 10:41:32.580] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: kill -9 108336 [2023-02-21 10:41:32.644] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:32.644] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:41:32.679] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:32.679] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ps uax | egrep " 15656 " | grep -v grep [2023-02-21 10:41:32.783] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:32.783] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid:15656] stopping ... [2023-02-21 10:41:32.783] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: kill -9 15656 [2023-02-21 10:41:32.848] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:32.849] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 10:41:32.927] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:32.928] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ps uax | egrep " 198942 " | grep -v grep [2023-02-21 10:41:33.042] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:33.042] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid:198942] stopping ... [2023-02-21 10:41:33.043] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: kill -9 198942 [2023-02-21 10:41:33.111] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.113] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) check whether the port is released [2023-02-21 10:41:34.113] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:34.141] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.141] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:34.206] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.206] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 10:41:34.264] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.265] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer is stopped [2023-02-21 10:41:34.265] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) check whether the port is released [2023-02-21 10:41:34.265] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:34.291] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.292] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:34.355] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.355] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 10:41:34.416] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.417] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer is stopped [2023-02-21 10:41:34.417] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) check whether the port is released [2023-02-21 10:41:34.417] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:34.442] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.442] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:34.507] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.507] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 10:41:34.569] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.569] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer is stopped [2023-02-21 10:41:34.590] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 10:41:34.591] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 10:41:34.591] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 10:41:34.591] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 10:41:34.592] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 10:41:34.593] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [INFO] Stop obproxy [2023-02-21 10:41:34.594] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:41:34.616] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.617] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/227241 [2023-02-21 10:41:34.678] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.678] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/227241/fd [2023-02-21 10:41:34.738] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:34.739] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid:227241] stopping ... [2023-02-21 10:41:34.739] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid | xargs kill -9; kill -9 -227241 [2023-02-21 10:41:34.800] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:35.801] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 10:41:35.801] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:35.830] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:35.831] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:35.894] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:35.894] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -f /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 10:41:35.953] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:35.954] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy is stopped [2023-02-21 10:41:36.030] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 10:41:36.030] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 10:41:36.030] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Call obagent-py_script_stop-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 10:41:36.030] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 10:41:36.032] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 10:41:36.032] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [INFO] Stop obagent [2023-02-21 10:41:36.033] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:41:36.055] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:36.055] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/109177 [2023-02-21 10:41:36.115] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:36.116] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent[pid:109177] stopping ... [2023-02-21 10:41:36.116] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: kill -9 109177 [2023-02-21 10:41:36.174] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:36.174] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:41:36.196] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:36.196] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/16488 [2023-02-21 10:41:36.257] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:36.258] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent[pid:16488] stopping ... [2023-02-21 10:41:36.258] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: kill -9 16488 [2023-02-21 10:41:36.317] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:36.317] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:41:36.341] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:36.342] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/199805 [2023-02-21 10:41:36.403] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:36.403] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent[pid:199805] stopping ... [2023-02-21 10:41:36.403] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: kill -9 199805 [2023-02-21 10:41:36.464] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:37.465] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) check whether the port is released [2023-02-21 10:41:37.466] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:37.492] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:37.492] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:37.557] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:37.558] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 10:41:37.618] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:37.619] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent is stopped [2023-02-21 10:41:37.619] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) check whether the port is released [2023-02-21 10:41:37.619] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:37.646] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:37.646] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:37.712] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:37.712] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 10:41:37.775] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:37.775] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent is stopped [2023-02-21 10:41:37.775] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) check whether the port is released [2023-02-21 10:41:37.776] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:37.802] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:37.802] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:37.868] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:37.869] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 10:41:37.932] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:37.932] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent is stopped [2023-02-21 10:41:37.990] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 10:41:37.990] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 10:41:37.990] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_stop-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 10:41:37.990] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 10:41:37.991] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 10:41:37.992] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [INFO] Stop prometheus [2023-02-21 10:41:37.992] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 10:41:38.015] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:38.016] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus is not running [2023-02-21 10:41:39.036] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 10:41:39.036] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 10:41:39.036] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Call grafana-py_script_stop-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 10:41:39.036] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 10:41:39.038] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 10:41:39.038] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [INFO] Stop grafana [2023-02-21 10:41:39.040] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 10:41:39.061] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:39.062] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/227679 [2023-02-21 10:41:39.123] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:39.124] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/227679/fd [2023-02-21 10:41:39.184] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:39.184] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana[pid:227679] stopping... [2023-02-21 10:41:39.184] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: kill -9 227679 [2023-02-21 10:41:39.244] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:40.245] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 10:41:40.246] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 10:41:40.273] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 10:41:40.273] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana is stopped [2023-02-21 10:41:40.344] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 10:41:40.344] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 10:41:40.344] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - Set observer deploy status to stopped [2023-02-21 10:41:40.344] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 10:41:40.350] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [INFO] observer stopped [2023-02-21 10:41:40.350] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 10:41:40.350] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 10:41:40.350] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 10:41:40.350] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 10:41:40.350] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 10:41:40.350] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 10:41:40.350] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 10:41:40.350] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 10:41:40.351] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 10:41:40.351] [3ed65932-b191-11ed-a1bc-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:05:54.488] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:05:54.489] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:05:54.489] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:05:54.489] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:05:54.489] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2023-02-21 11:05:54.489] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:05:54.489] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:05:54.490] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:05:54.490] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:05:54.490] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:05:54.504] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 11:05:54.504] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [ERROR] [ERROR] Deploy need reload. [2023-02-21 11:05:54.504] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [ERROR] Use `obd cluster reload observer` to make changes take effect. [2023-02-21 11:05:54.504] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [ERROR] If you still need to start the cluster, use the `obd cluster start observer --wop` option to start the cluster without loading parameters. [2023-02-21 11:05:54.504] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 11:05:54.504] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:05:54.504] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:05:54.504] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:05:54.504] [a7ae9714-b194-11ed-9d7f-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:07:42.326] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:07:42.326] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:07:42.327] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:07:42.327] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:07:42.327] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - opts: {} [2023-02-21 11:07:42.327] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:07:42.327] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:07:42.327] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:07:42.327] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:07:42.327] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:07:42.338] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 11:07:42.339] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [ERROR] [ERROR] Deploy "observer" is stopped. You could not reload an stopped cluster. [2023-02-21 11:07:42.339] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 11:07:42.339] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:07:42.339] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:07:42.339] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:07:42.339] [e7f578b0-b194-11ed-be70-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:08:07.591] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:08:07.592] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:08:07.593] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:08:07.593] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:08:07.593] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2023-02-21 11:08:07.593] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:08:07.593] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:08:07.593] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:08:07.594] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:08:07.594] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:08:07.614] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 11:08:07.614] [f704a600-b194-11ed-92a3-fa163e9e21e4] [ERROR] [ERROR] Deploy need reload. [2023-02-21 11:08:07.614] [f704a600-b194-11ed-92a3-fa163e9e21e4] [ERROR] Use `obd cluster reload observer` to make changes take effect. [2023-02-21 11:08:07.614] [f704a600-b194-11ed-92a3-fa163e9e21e4] [ERROR] If you still need to start the cluster, use the `obd cluster start observer --wop` option to start the cluster without loading parameters. [2023-02-21 11:08:07.614] [f704a600-b194-11ed-92a3-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 11:08:07.614] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:08:07.614] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:08:07.614] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:08:07.615] [f704a600-b194-11ed-92a3-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:08:44.651] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:08:44.652] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:08:44.652] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:08:44.652] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:08:44.652] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': True} [2023-02-21 11:08:44.652] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:08:44.653] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:08:44.653] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:08:44.653] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:08:44.654] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:08:44.672] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 11:08:44.673] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 11:08:44.674] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 11:08:44.674] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:44.675] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: 4.0.0.0, tag: 1d56dc742f5f05a2d15797d291b51a94019e728d, release: None, package_hash: None [2023-02-21 11:08:44.675] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:08:44.675] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 11:08:44.675] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2023-02-21 11:08:44.680] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:44.680] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:08:44.680] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: de53232a951184fad75b15884458d85e31d2f6c3, release: None, package_hash: None [2023-02-21 11:08:44.680] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 11:08:44.680] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2023-02-21 11:08:44.684] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:08:44.684] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:08:44.685] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Search repository obagent version: 1.2.0, tag: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e, release: None, package_hash: None [2023-02-21 11:08:44.685] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 11:08:44.685] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obagent [2023-02-21 11:08:44.689] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:08:44.689] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:08:44.689] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Search repository prometheus version: 2.37.1, tag: 58913c7606f05feb01bc1c6410346e5fc31cf263, release: None, package_hash: None [2023-02-21 11:08:44.690] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 11:08:44.690] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/prometheus [2023-02-21 11:08:44.694] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:08:44.694] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:08:44.694] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Search repository grafana version: 7.5.17, tag: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, release: None, package_hash: None [2023-02-21 11:08:44.694] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 11:08:44.694] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/grafana [2023-02-21 11:08:44.698] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:08:44.805] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 11:08:44.890] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Search plugins [2023-02-21 11:08:44.891] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start_check plugin for components ... [2023-02-21 11:08:44.892] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:44.892] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 11:08:44.894] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:08:44.894] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:08:44.895] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:08:44.895] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:08:44.895] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start_check-1.1.1 for obagent-1.2.0 [2023-02-21 11:08:44.895] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start_check plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:08:44.896] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1 [2023-02-21 11:08:44.896] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start_check plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:08:44.896] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start_check-7.5.17 for grafana-7.5.17 [2023-02-21 11:08:44.896] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 11:08:44.896] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:44.897] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:08:44.897] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:08:44.897] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:08:44.897] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:08:44.898] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 11:08:44.898] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:08:44.898] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 11:08:44.898] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:08:44.899] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 11:08:44.899] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 11:08:44.899] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:44.899] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:08:44.900] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:08:44.900] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:08:44.900] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:08:44.900] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 11:08:44.900] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:08:44.901] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 11:08:44.901] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:08:44.901] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 11:08:44.901] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 11:08:44.901] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:44.902] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:08:44.902] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:08:44.903] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:08:44.903] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:08:44.903] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 11:08:44.903] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:08:44.903] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 11:08:44.904] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:08:44.904] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 11:08:44.904] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 11:08:44.904] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:44.905] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:08:44.905] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:08:44.905] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:08:44.905] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:08:44.906] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 11:08:44.906] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:08:44.906] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 11:08:44.906] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:08:44.906] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 11:08:45.023] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 11:08:46.458] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 11:08:46.459] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 11:08:46.459] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 11:08:46.460] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:08:46.460] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:47.157] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 11:08:47.157] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:08:47.157] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:08:47.323] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 11:08:47.324] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 11:08:47.324] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:08:47.425] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 11:08:47.426] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 11:08:47.426] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:08:47.449] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 11:08:47.449] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 11:08:47.449] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:08:47.490] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:47.490] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 11:08:47.498] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 11:08:47.499] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Check before start observer [2023-02-21 11:08:47.500] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:08:47.534] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:08:47.534] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:08:47.535] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:47.535] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) port check [2023-02-21 11:08:47.535] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:47.603] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:47.603] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:47.672] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:47.672] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /topevery/obdata/sstable/block_file [2023-02-21 11:08:47.735] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:47.736] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:08:47.767] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:08:47.768] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:08:47.768] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:47.768] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) port check [2023-02-21 11:08:47.768] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:47.832] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:47.832] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:47.895] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:47.896] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /data/obdata/sstable/block_file [2023-02-21 11:08:47.956] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:47.957] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:08:47.980] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:08:47.981] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:08:47.981] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:47.981] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) port check [2023-02-21 11:08:47.981] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:48.052] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.053] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:48.121] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.122] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /data/obdata/sstable/block_file [2023-02-21 11:08:48.188] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.188] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 11:08:48.211] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.212] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ulimit -a [2023-02-21 11:08:48.270] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.271] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.65) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:08:48.272] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/meminfo [2023-02-21 11:08:48.329] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.330] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [WARNING] [WARN] OBD-2000: (10.253.208.65) not enough memory. (Free: 5.1G, Need: 10.0G) [2023-02-21 11:08:48.330] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: df --block-size=1024 [2023-02-21 11:08:48.393] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.393] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 51118350336, 'need': 0}, '/dev': {'total': 20979048448, 'avail': 20979048448, 'need': 0}, '/dev/shm': {'total': 20991266816, 'avail': 20991266816, 'need': 0}, '/run': {'total': 20991266816, 'avail': 20006989824, 'need': 0}, '/sys/fs/cgroup': {'total': 20991266816, 'avail': 20991266816, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 889667584, 'need': 0}, '/home': {'total': 44127686656, 'avail': 42829266944, 'need': 0}, '/topevery': {'total': 2113643364352, 'avail': 660664541184, 'need': 0}, '/run/user/0': {'total': 4198256640, 'avail': 4198256640, 'need': 0}, '/run/user/1001': {'total': 4198256640, 'avail': 4198256640, 'need': 0}} [2023-02-21 11:08:48.394] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 11:08:48.418] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.419] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ulimit -a [2023-02-21 11:08:48.479] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.480] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.67) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:08:48.480] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/meminfo [2023-02-21 11:08:48.540] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.540] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: df --block-size=1024 [2023-02-21 11:08:48.609] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.609] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 50947399680, 'need': 0}, '/dev': {'total': 8296525824, 'avail': 8296525824, 'need': 0}, '/dev/shm': {'total': 8308740096, 'avail': 8308736000, 'need': 0}, '/run': {'total': 8308740096, 'avail': 7425101824, 'need': 0}, '/sys/fs/cgroup': {'total': 8308740096, 'avail': 8308740096, 'need': 0}, '/data': {'total': 211242950656, 'avail': 60839268352, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 889667584, 'need': 0}, '/home': {'total': 44127686656, 'avail': 42832424960, 'need': 0}, '/run/user/0': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1000': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1001': {'total': 1661751296, 'avail': 1661751296, 'need': 0}} [2023-02-21 11:08:48.609] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 11:08:48.633] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.633] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ulimit -a [2023-02-21 11:08:48.695] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.696] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.172) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:08:48.696] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/meminfo [2023-02-21 11:08:48.760] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.761] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: df --block-size=1024 [2023-02-21 11:08:48.824] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.824] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 41970479104, 'need': 0}, '/dev': {'total': 8291450880, 'avail': 8291450880, 'need': 0}, '/dev/shm': {'total': 8308744192, 'avail': 8308715520, 'need': 0}, '/run': {'total': 8308744192, 'avail': 8079097856, 'need': 0}, '/sys/fs/cgroup': {'total': 8308744192, 'avail': 8308744192, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 844517376, 'need': 0}, '/home': {'total': 48420556800, 'avail': 47106760704, 'need': 0}, '/data': {'total': 316924559360, 'avail': 161148338176, 'need': 0}, '/run/user/0': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1002': {'total': 1661751296, 'avail': 1661751296, 'need': 0}} [2023-02-21 11:08:48.825] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: date +%s%N [2023-02-21 11:08:48.847] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.848] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.65 time delta -1.607666015625 [2023-02-21 11:08:48.848] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: date +%s%N [2023-02-21 11:08:48.875] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.876] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.67 time delta -1.51708984375 [2023-02-21 11:08:48.876] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: date +%s%N [2023-02-21 11:08:48.899] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:48.899] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.172 time delta -1.943603515625 [2023-02-21 11:08:48.935] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.65) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:08:48.935] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] [WARN] OBD-2000: (10.253.208.65) not enough memory. (Free: 5.1G, Need: 10.0G) [2023-02-21 11:08:48.935] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.67) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:08:48.935] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.172) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:08:48.935] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] [2023-02-21 11:08:48.935] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 11:08:48.935] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 11:08:48.935] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:08:48.935] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 11:08:48.936] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 11:08:48.937] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Check before start obproxy [2023-02-21 11:08:48.938] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:08:48.960] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:08:48.960] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 11:08:48.960] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:48.961] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 11:08:48.961] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:49.023] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.023] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:49.088] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.199] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 11:08:49.199] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 11:08:49.199] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start_check-1.1.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:08:49.199] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 11:08:49.201] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 11:08:49.201] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Check before start obagent [2023-02-21 11:08:49.202] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:08:49.225] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:08:49.225] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 11:08:49.225] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:49.225] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) port check [2023-02-21 11:08:49.225] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:49.290] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.290] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:49.355] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.355] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:08:49.377] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:08:49.377] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 11:08:49.377] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:49.377] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) port check [2023-02-21 11:08:49.377] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:49.440] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.441] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:49.504] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.504] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:08:49.529] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:08:49.529] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 11:08:49.529] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:49.529] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) port check [2023-02-21 11:08:49.529] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:49.596] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.596] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:49.664] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.725] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 11:08:49.725] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 11:08:49.725] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:08:49.725] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 11:08:49.727] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 11:08:49.729] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Check before start prometheus [2023-02-21 11:08:49.729] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:08:49.752] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.752] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 11:08:49.752] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:49.814] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.860] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 11:08:49.860] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 11:08:49.860] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start_check-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:08:49.860] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 11:08:49.862] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 11:08:49.862] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Check before start grafana [2023-02-21 11:08:49.863] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 11:08:49.883] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:49.883] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/227679 [2023-02-21 11:08:49.944] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 11:08:49.944] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/227679: 没有那个文件或目录 [2023-02-21 11:08:49.944] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:49.944] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 11:08:49.944] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:08:50.007] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:50.124] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 11:08:50.124] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 11:08:50.125] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:50.125] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import start [2023-02-21 11:08:50.128] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 11:08:50.129] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Start observer [2023-02-21 11:08:50.130] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:08:50.153] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:08:50.154] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:08:50.154] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:50.154] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) start command construction [2023-02-21 11:08:50.154] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 11:08:50.216] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:50.217] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:08:50.237] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:08:50.237] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:08:50.237] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:50.238] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) start command construction [2023-02-21 11:08:50.238] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 11:08:50.299] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:50.299] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:08:50.327] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:08:50.328] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:08:50.328] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:08:50.328] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) start command construction [2023-02-21 11:08:50.328] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 11:08:50.399] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:50.399] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- starting server1(10.253.208.65) observer [2023-02-21 11:08:50.400] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:08:50.400] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 11:08:50.576] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:50.577] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 delete env LD_LIBRARY_PATH [2023-02-21 11:08:50.577] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- starting server2(10.253.208.67) observer [2023-02-21 11:08:50.577] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:08:50.577] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 11:08:50.736] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:50.736] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 delete env LD_LIBRARY_PATH [2023-02-21 11:08:50.736] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- starting server3(10.253.208.172) observer [2023-02-21 11:08:50.737] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:08:50.737] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 11:08:51.762] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:51.763] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 delete env LD_LIBRARY_PATH [2023-02-21 11:08:51.826] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] observer program health check [2023-02-21 11:08:54.829] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 11:08:54.830] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:08:54.854] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:54.854] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/114463 [2023-02-21 11:08:54.917] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:54.917] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid: 114463] started [2023-02-21 11:08:54.918] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 11:08:54.918] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:08:54.978] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:54.979] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/21535 [2023-02-21 11:08:55.068] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:55.068] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid: 21535] started [2023-02-21 11:08:55.068] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 11:08:55.068] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:08:55.133] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:55.134] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/206277 [2023-02-21 11:08:55.239] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:08:55.239] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid: 206277] started [2023-02-21 11:08:55.347] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 11:08:55.347] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export start [2023-02-21 11:08:55.347] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:55.347] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 11:08:55.385] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 11:08:55.385] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Connect to observer [2023-02-21 11:08:55.386] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 11:08:55.777] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 11:08:55.777] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 11:08:55.777] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 11:08:55.778] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:08:55.778] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 11:08:55.779] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 11:08:55.780] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 11:09:05.838] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 4012:Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. [2023-02-21 11:09:05.838] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- execute sql: alter system bootstrap REGION "sys_region" ZONE "zone1" SERVER "10.253.208.65:2882",REGION "sys_region" ZONE "zone2" SERVER "10.253.208.67:2882",REGION "sys_region" ZONE "zone3" SERVER "10.253.208.172:2882" [2023-02-21 11:09:05.841] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "core.py", line 1446, in start_cluster [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "core.py", line 1552, in _start_cluster [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/bootstrap.py", line 87, in bootstrap [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] cursor.execute(sql) [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 11:09:05.842] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] result.read() [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (4015, 'System error') [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] [2023-02-21 11:09:05.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2023-02-21 11:09:05.844] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 11:09:10.044] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 11:09:10.045] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 11:09:10.118] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:09:10.119] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import start [2023-02-21 11:09:10.121] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 11:09:10.123] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Start obproxy [2023-02-21 11:09:10.123] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/obproxy/etc/obproxy_config.bin [2023-02-21 11:09:10.147] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:10.148] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 11:09:10.148] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:09:10.208] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:10.208] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 11:09:10.208] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:10.208] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- starting 10.253.208.63 obproxy [2023-02-21 11:09:10.209] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/obproxy/lib:' [2023-02-21 11:09:10.209] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/obproxy; /data/obdata/obproxy/bin/obproxy --listen_port 2883 [2023-02-21 11:09:10.404] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:10.405] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 delete env LD_LIBRARY_PATH [2023-02-21 11:09:10.405] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/obproxy/bin/obproxy --listen_port 2883$' | grep -v grep | awk '{print $2}' > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:09:10.500] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:10.516] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] obproxy program health check [2023-02-21 11:09:10.517] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:10.517] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:09:10.564] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:10.565] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:10.628] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:10.629] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 19 [2023-02-21 11:09:11.629] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:11.629] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:09:11.653] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:11.653] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:11.719] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:11.719] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 18 [2023-02-21 11:09:12.720] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:12.721] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:09:12.747] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:12.748] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:12.812] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:12.813] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 2104380173 [2023-02-21 11:09:12.813] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:12.813] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/236014/fd/ |grep -E 'socket:\[(2104380173)\]' [2023-02-21 11:09:12.879] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:12.879] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 11:09:12.941] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 11:09:12.942] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/227219: 没有那个文件或目录 [2023-02-21 11:09:12.942] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:12.942] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: echo 236014 > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:09:13.005] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:13.092] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 11:09:13.092] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/obproxy && rm -fr /data/obdata/obproxy/obproxyd.sh [2023-02-21 11:09:13.118] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:13.118] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /data/obdata/obproxy/obproxyd.sh [2023-02-21 11:09:13.162] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/obproxy/obproxyd.sh [2023-02-21 11:09:13.184] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:13.184] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash /data/obdata/obproxy/obproxyd.sh /data/obdata/obproxy 10.253.208.63 2883 [2023-02-21 11:09:13.247] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:14.249] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:14.249] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:09:14.271] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:14.271] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:14.339] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:14.339] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 16 [2023-02-21 11:09:15.340] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:15.340] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:09:15.365] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:15.365] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:15.430] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:15.431] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 15 [2023-02-21 11:09:16.432] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:16.432] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:09:16.456] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:16.456] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:16.519] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:16.519] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 2104380265 [2023-02-21 11:09:16.519] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:16.519] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/236263/fd/ |grep -E 'socket:\[(2104380265)\]' [2023-02-21 11:09:16.582] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:16.582] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 11:09:16.646] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:16.646] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid: 236263] started [2023-02-21 11:09:16.777] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 11:09:16.777] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export start [2023-02-21 11:09:16.777] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:09:16.777] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 11:09:16.779] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 11:09:16.779] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Connect to obproxy [2023-02-21 11:09:16.780] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- connect 10.253.208.63 -P2883 -uroot@proxysys -p [2023-02-21 11:09:16.910] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 11:09:16.910] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 11:09:16.911] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:09:16.911] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import start [2023-02-21 11:09:16.993] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 11:09:16.994] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Start obagent [2023-02-21 11:09:17.031] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:09:17.058] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:17.059] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 11:09:17.059] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:17.060] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:17.143] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 11:09:17.143] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:17.165] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:17.166] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp0szx9k_7.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:17.211] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:17.235] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:17.238] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:17.239] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:17.299] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:17.299] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpej_yqcrq.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:17.345] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:17.366] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:17.369] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:17.370] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:17.429] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:17.430] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpcq65d9vx.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:17.475] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:17.497] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:17.500] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 11:09:17.500] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:09:17.558] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:17.559] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmprbdl1hfw.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:09:17.602] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:09:17.624] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:17.626] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:17.627] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:17.687] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:17.687] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpdpvv4spd.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:17.732] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:17.754] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:17.758] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:17.758] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:17.819] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:17.819] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp71q8jbkr.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:17.865] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:17.888] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:17.891] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:17.892] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:17.951] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:17.951] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp57ttqeqr.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:18.002] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:18.029] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:18.035] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:18.035] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:18.094] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:18.094] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp00hv2gnx.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:18.140] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:18.162] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:18.165] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:18.166] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:18.225] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:18.225] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpjh4vtb_9.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:18.272] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:18.294] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:18.300] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:09:18.356] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:18.357] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp2zymbu9a.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:09:18.402] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:09:18.425] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:18.429] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:09:18.486] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:18.487] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:09:18.512] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:18.512] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 11:09:18.512] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:18.513] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:18.599] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 11:09:18.599] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:18.622] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:18.622] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpb8ighu0q.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:18.673] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:18.696] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:18.699] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:18.700] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:18.763] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:18.763] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp395xhtb0.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:18.813] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:18.834] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:18.839] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:18.839] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:18.901] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:18.901] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpout6g2nc.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:18.951] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:18.974] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:18.977] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 11:09:18.978] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:09:19.036] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:19.037] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpbfurfe7t.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:09:19.084] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:09:19.104] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:19.107] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:19.108] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:19.170] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:19.170] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp4n7cpnmi.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:19.245] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:19.286] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:19.288] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:19.289] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:19.359] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:19.359] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp8upy84c2.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:19.408] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:19.429] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:19.433] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:19.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:19.497] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:19.498] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp087979wq.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:19.552] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:19.576] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:19.581] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:19.581] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:19.639] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:19.640] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpn5r7wcmu.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:19.691] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:19.718] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:19.721] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:19.722] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:19.798] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:19.798] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpwbmpo1w3.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:19.847] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:19.871] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:19.878] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:09:19.946] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:19.946] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp25t3fpyy.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:09:19.996] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:09:20.018] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:20.021] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:09:20.084] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:20.085] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:09:20.123] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:20.124] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 11:09:20.124] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:20.124] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:20.215] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 11:09:20.216] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:20.245] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:20.246] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpcjez2v5l.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:20.291] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:09:20.318] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:20.321] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:20.322] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:20.387] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:20.387] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpunnobasn.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:20.432] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:09:20.459] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:20.462] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:20.463] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:20.529] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:20.529] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpvcd8ijj8.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:20.573] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:09:20.606] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:20.609] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 11:09:20.610] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:09:20.675] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:20.675] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpph2vit8p.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:09:20.718] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:09:20.744] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:20.746] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:20.747] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:20.811] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:20.811] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmplore0syk.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:20.856] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:09:20.881] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:20.884] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:20.884] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:20.949] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:20.950] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpgt4pwyvf.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:20.996] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:09:21.021] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:21.025] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:21.026] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:21.092] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:21.092] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmprl8spepj.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:21.141] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:09:21.173] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:21.179] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:21.179] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:21.259] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:21.259] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpgkzo2tfo.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:21.304] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:09:21.339] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:21.342] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:21.342] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:21.408] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:21.408] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmppzsc7tf3.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:21.452] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:09:21.481] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:21.487] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:09:21.551] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:21.551] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp_o_s5wjz.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:09:21.595] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:09:21.631] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:21.634] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:09:21.701] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:21.820] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] obagent program health check [2023-02-21 11:09:22.822] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 11:09:22.822] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:09:22.844] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:22.845] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:22.918] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:22.919] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 11:09:22.919] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:09:22.981] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:22.981] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:23.058] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:23.059] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 11:09:23.059] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:09:23.094] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:23.094] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:23.177] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:23.177] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- start to sync target config [2023-02-21 11:09:23.255] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 11:09:23.255] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export start [2023-02-21 11:09:23.255] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call obagent-py_script_connect-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:09:23.255] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 11:09:23.256] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 11:09:23.256] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 11:09:23.256] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 11:09:23.256] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:09:23.256] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import start [2023-02-21 11:09:23.259] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 11:09:23.259] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Start promethues [2023-02-21 11:09:23.260] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/.prometheus_started [2023-02-21 11:09:23.281] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:23.282] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:09:23.342] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:23.343] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:09:23.402] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:23.433] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- write global: [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] scrape_interval: 1s [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] evaluation_interval: 10s [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] rule_files: [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - rules/*rules.yaml [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] scrape_configs: [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - job_name: prometheus [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] metrics_path: /metrics [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.63:9090 [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - job_name: node [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] password: root [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] metrics_path: /metrics/node/host [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 11:09:23.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - files: [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - job_name: ob_basic [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] password: root [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/basic [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - files: [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - job_name: ob_extra [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] password: root [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/extra [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 11:09:23.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - files: [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - job_name: agent [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] password: root [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] metrics_path: /metrics/stat [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - files: [2023-02-21 11:09:23.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - targets/*.yaml to admin@10.253.208.63:22: /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:09:23.437] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:09:23.462] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:23.462] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmppou5n54b to /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:09:23.508] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:09:23.529] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:23.533] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 11:09:23.592] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:23.592] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 11:09:23.636] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 11:09:23.656] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:23.657] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle --start-only [2023-02-21 11:09:23.762] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:23.763] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheus.pid` && ls /proc/$pid [2023-02-21 11:09:23.826] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:24.915] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] prometheus program health check [2023-02-21 11:09:24.916] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:24.916] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:09:24.937] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:24.937] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:25.004] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:25.004] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 2104312881 [2023-02-21 11:09:25.004] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:25.004] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/227509/fd/ |grep -E 'socket:\[(2104312881)\]' [2023-02-21 11:09:25.066] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:25.066] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 11:09:25.128] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 11:09:25.128] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/219897: 没有那个文件或目录 [2023-02-21 11:09:25.128] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:25.129] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 11:09:25.189] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:25.189] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 11:09:25.234] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 11:09:25.255] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:25.255] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle [2023-02-21 11:09:25.327] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:26.329] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:26.329] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:09:26.350] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:26.351] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:26.419] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:26.419] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 prometheus, remaining retries: 18 [2023-02-21 11:09:27.420] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:27.420] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:09:27.452] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:27.452] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:27.518] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:27.518] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 2104380305 [2023-02-21 11:09:27.518] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:27.518] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/236687/fd/ |grep -E 'socket:\[(2104380305)\]' [2023-02-21 11:09:27.579] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:27.579] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 11:09:27.645] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:27.646] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheusd[pid: 236687] started [2023-02-21 11:09:27.654] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 11:09:27.654] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export start [2023-02-21 11:09:27.654] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:09:27.655] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 11:09:27.656] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 11:09:27.656] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Connect to Prometheus [2023-02-21 11:09:27.657] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- connect prometheus (10.253.208.63:9090 by user None) [2023-02-21 11:09:27.657] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 11:09:27.787] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 11:09:27.788] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 11:09:27.788] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 11:09:27.788] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:09:27.788] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 11:09:27.789] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 11:09:27.789] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: touch /data/obdata/prometheus/.prometheus_started [2023-02-21 11:09:27.809] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:27.810] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 11:09:27.810] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 11:09:27.919] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:09:27.919] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import start [2023-02-21 11:09:27.922] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 11:09:27.923] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Start grafana [2023-02-21 11:09:27.924] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate obd-grafana ini file [2023-02-21 11:09:27.925] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf && rm -fr /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 11:09:27.946] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:27.946] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpqj101ljf.ini to /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 11:09:27.991] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 11:09:28.011] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:28.014] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate datasources yaml [2023-02-21 11:09:28.017] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 11:09:28.017] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] datasources: [2023-02-21 11:09:28.018] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - name: OB-Prometheus [2023-02-21 11:09:28.018] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] isDefault: 'true' [2023-02-21 11:09:28.018] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] type: prometheus [2023-02-21 11:09:28.018] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] access: proxy [2023-02-21 11:09:28.018] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] editable: 'true' [2023-02-21 11:09:28.018] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] url: http://10.253.208.63:9090 to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 11:09:28.019] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/datasources && rm -fr /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 11:09:28.074] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:28.075] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmpcg2mn27i to /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 11:09:28.120] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 11:09:28.141] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:28.143] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate providers yaml [2023-02-21 11:09:28.146] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 11:09:28.146] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] providers: [2023-02-21 11:09:28.146] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - name: OceanBase Metrics [2023-02-21 11:09:28.147] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] type: file [2023-02-21 11:09:28.147] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] allowUiUpdates: 'true' [2023-02-21 11:09:28.147] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] options: [2023-02-21 11:09:28.147] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] path: /data/obdata/grafana/conf/provisioning/dashboards/templates to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 11:09:28.147] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 11:09:28.203] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:28.204] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send /tmp/tmp58lc5jni to /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 11:09:28.249] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 11:09:28.272] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:09:28.275] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 11:09:28.360] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:28.360] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/grafana; bash -c '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid > /data/obdata/grafana/data/log/grafana-console.log 2>&1 &' [2023-02-21 11:09:28.425] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:28.425] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 11:09:28.517] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:29.578] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] grafana program health check [2023-02-21 11:09:29.579] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:29.579] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:29.579] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:29.604] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:29.604] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:29.665] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:29.665] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:29.665] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:29.665] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 19 [2023-02-21 11:09:30.667] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:30.667] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:30.667] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:30.692] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:30.693] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:30.753] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:30.753] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:30.753] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:30.753] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 18 [2023-02-21 11:09:31.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:31.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:31.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:31.782] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:31.782] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:31.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:31.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:31.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:31.843] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 17 [2023-02-21 11:09:32.844] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:32.845] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:32.845] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:32.870] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:32.870] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:32.929] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:32.929] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:32.929] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:32.929] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 16 [2023-02-21 11:09:33.931] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:33.931] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:33.931] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:33.959] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:33.960] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:34.020] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:34.021] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:34.021] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:34.021] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 15 [2023-02-21 11:09:35.022] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:35.022] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:35.022] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:35.051] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:35.051] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:35.112] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:35.112] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:35.112] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:35.112] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 14 [2023-02-21 11:09:36.113] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:36.113] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:36.114] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:36.138] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:36.138] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:36.197] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:36.198] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:36.198] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:36.198] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 13 [2023-02-21 11:09:37.199] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:37.200] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:37.200] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:37.225] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:37.226] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:37.286] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:37.286] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:37.286] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:37.287] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 12 [2023-02-21 11:09:38.288] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:38.288] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:38.288] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:38.314] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:38.314] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:38.375] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:38.376] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:38.376] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:38.376] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 11 [2023-02-21 11:09:39.377] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:39.378] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:39.378] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:39.402] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:39.402] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:39.461] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:39.461] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:39.462] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:39.462] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 10 [2023-02-21 11:09:40.463] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:40.463] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:40.463] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:40.489] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:40.490] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:40.552] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:40.553] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:40.553] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:40.553] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 9 [2023-02-21 11:09:41.554] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:41.555] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:41.555] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:41.579] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:41.580] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:41.641] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:41.641] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:41.641] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:41.641] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 8 [2023-02-21 11:09:42.642] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:42.643] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:42.643] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:42.670] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:42.670] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:42.730] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:42.731] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:42.731] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:42.731] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 7 [2023-02-21 11:09:43.732] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:43.732] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:43.732] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:43.760] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:43.761] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:43.823] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:43.824] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:43.824] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:43.824] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 6 [2023-02-21 11:09:44.825] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:44.825] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:44.825] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:44.854] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:44.854] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:44.914] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:44.915] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:44.915] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:44.915] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 5 [2023-02-21 11:09:45.916] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:45.916] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:45.916] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:45.942] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:45.943] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:46.009] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:46.009] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:46.009] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:46.009] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 4 [2023-02-21 11:09:47.010] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:47.010] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:47.010] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:47.035] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:47.035] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:47.096] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:47.096] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:47.096] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:47.097] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 3 [2023-02-21 11:09:48.098] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:48.098] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:48.098] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:48.124] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:48.124] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:48.187] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:48.187] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:48.187] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:48.188] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 2 [2023-02-21 11:09:49.189] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:49.189] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:49.189] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:49.216] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:49.217] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:49.277] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:49.278] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:49.278] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:49.278] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 1 [2023-02-21 11:09:50.279] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:09:50.279] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fcf0ba115f8>: ['']} [2023-02-21 11:09:50.280] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:09:50.305] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:50.306] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104382644)\]' [2023-02-21 11:09:50.366] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:09:50.367] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:09:50.367] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] [2023-02-21 11:09:50.367] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 0 [2023-02-21 11:09:50.434] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [WARNING] [WARN] failed to start 10.253.208.63 grafana [2023-02-21 11:09:50.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 11:09:50.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export start [2023-02-21 11:09:50.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [ERROR] [ERROR] grafana start failed [2023-02-21 11:09:50.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:09:50.435] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import display [2023-02-21 11:09:50.436] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 11:09:50.437] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] Wait for observer init [2023-02-21 11:09:50.443] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 11:09:50.443] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | observer | [2023-02-21 11:09:50.443] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:09:50.443] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 11:09:50.443] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:09:50.443] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 11:09:50.443] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 11:09:50.443] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 11:09:50.444] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:09:50.444] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | observer | [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 11:09:50.569] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export display [2023-02-21 11:09:50.570] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:09:50.570] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import display [2023-02-21 11:09:50.570] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 11:09:50.581] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +-------------------------------------------------+ [2023-02-21 11:09:50.581] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | obproxy | [2023-02-21 11:09:50.581] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 11:09:50.581] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | ip | port | prometheus_port | status | [2023-02-21 11:09:50.581] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 11:09:50.581] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | 10.253.208.63 | 2883 | 2884 | active | [2023-02-21 11:09:50.581] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 11:09:50.582] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] obclient -h10.253.208.63 -P2883 -uroot -Doceanbase -A [2023-02-21 11:09:50.582] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 11:09:50.582] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export display [2023-02-21 11:09:50.582] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call obagent-py_script_display-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:09:50.582] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import display [2023-02-21 11:09:50.583] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 11:09:50.583] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.65:8088/metrics/stat" [2023-02-21 11:09:50.622] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:50.622] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.67:8088/metrics/stat" [2023-02-21 11:09:50.667] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:50.667] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.172:8088/metrics/stat" [2023-02-21 11:09:50.748] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +----------------------------------------------------+ [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | obagent | [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | ip | server_port | pprof_port | status | [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | 10.253.208.65 | 8088 | 8089 | active | [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | 10.253.208.67 | 8088 | 8089 | active | [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | 10.253.208.172 | 8088 | 8089 | active | [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 11:09:50.750] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export display [2023-02-21 11:09:50.751] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:09:50.751] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - import display [2023-02-21 11:09:50.751] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 11:09:50.752] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 11:09:50.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +------------------------------------------------------+ [2023-02-21 11:09:50.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | prometheus | [2023-02-21 11:09:50.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 11:09:50.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 11:09:50.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 11:09:50.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] | http://10.253.208.63:9090 | | | active | [2023-02-21 11:09:50.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 11:09:50.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 11:09:50.755] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - export display [2023-02-21 11:09:50.756] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 11:09:50.756] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 11:09:50.756] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 11:09:50.756] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 11:09:50.756] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 11:09:50.756] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 11:09:50.757] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:09:50.757] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:09:50.757] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:09:50.757] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:09:50.757] [0d1b6d52-b195-11ed-a2fc-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:17:47.158] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:17:47.159] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:17:47.159] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:17:47.159] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:17:47.159] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - opts: {} [2023-02-21 11:17:47.159] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:17:47.159] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:17:47.159] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:17:47.160] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:17:47.160] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:17:47.170] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 11:17:47.170] [5077801c-b196-11ed-bccc-fa163e9e21e4] [ERROR] [ERROR] Deploy "observer" is stopped. You could not reload an stopped cluster. [2023-02-21 11:17:47.170] [5077801c-b196-11ed-bccc-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 11:17:47.170] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:17:47.171] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:17:47.171] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:17:47.171] [5077801c-b196-11ed-bccc-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:19:18.475] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:19:18.476] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:19:18.476] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:19:18.476] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:19:18.476] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None} [2023-02-21 11:19:18.476] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:19:18.477] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:19:18.477] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:19:18.477] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:19:18.477] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:19:18.488] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Check the deploy status [2023-02-21 11:19:18.488] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 11:19:18.489] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 11:19:18.489] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:19:18.490] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:19:18.490] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 11:19:18.492] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:19:18.492] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 11:19:18.495] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:19:18.495] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 11:19:18.498] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:19:18.498] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 11:19:18.500] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:19:18.500] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 11:19:18.619] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 11:19:18.667] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [INFO] Search plugins [2023-02-21 11:19:18.668] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 11:19:18.668] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 11:19:18.668] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 11:19:18.669] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:19:18.669] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:19:19.342] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 11:19:19.343] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:19:19.343] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:19:19.521] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 11:19:19.522] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 11:19:19.522] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:19:19.640] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 11:19:19.640] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 11:19:19.640] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:19:19.664] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 11:19:19.664] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 11:19:19.664] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:19:19.697] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Searching stop plugin for components ... [2023-02-21 11:19:19.698] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:19:19.699] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:19:19.699] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:19:19.699] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:19:19.699] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Searching stop plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:19:19.699] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_stop-0.1 for obagent-1.2.0 [2023-02-21 11:19:19.699] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Searching stop plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:19:19.699] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_stop-2.37.1 for prometheus-2.37.1 [2023-02-21 11:19:19.700] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Searching stop plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:19:19.700] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_stop-7.5.17 for grafana-7.5.17 [2023-02-21 11:19:19.707] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 11:19:20.752] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:19:20.752] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 11:19:20.754] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 11:19:20.754] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [INFO] Stop observer [2023-02-21 11:19:20.755] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:19:20.860] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:20.860] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ps uax | egrep " 114463 " | grep -v grep [2023-02-21 11:19:20.974] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:20.974] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid:114463] stopping ... [2023-02-21 11:19:20.974] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: kill -9 114463 [2023-02-21 11:19:21.038] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:21.039] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:19:21.065] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:21.065] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ps uax | egrep " 21535 " | grep -v grep [2023-02-21 11:19:21.160] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:21.160] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid:21535] stopping ... [2023-02-21 11:19:21.160] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: kill -9 21535 [2023-02-21 11:19:21.222] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:21.223] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:19:21.256] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:21.257] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ps uax | egrep " 206277 " | grep -v grep [2023-02-21 11:19:21.398] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:21.399] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid:206277] stopping ... [2023-02-21 11:19:21.399] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: kill -9 206277 [2023-02-21 11:19:21.478] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:22.479] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) check whether the port is released [2023-02-21 11:19:22.479] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:22.506] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:22.507] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:22.571] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:22.571] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 11:19:22.631] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:22.632] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer is stopped [2023-02-21 11:19:22.632] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) check whether the port is released [2023-02-21 11:19:22.632] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:22.654] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:22.654] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:22.714] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:22.714] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 11:19:22.777] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:22.777] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer is stopped [2023-02-21 11:19:22.778] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) check whether the port is released [2023-02-21 11:19:22.778] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:22.809] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:22.809] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:22.881] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:22.881] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 11:19:22.951] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:22.952] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer is stopped [2023-02-21 11:19:22.971] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 11:19:22.971] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 11:19:22.971] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:19:22.972] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 11:19:22.973] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 11:19:22.973] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [INFO] Stop obproxy [2023-02-21 11:19:22.974] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:19:23.001] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:23.001] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/236263 [2023-02-21 11:19:23.062] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:23.062] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/236263/fd [2023-02-21 11:19:23.121] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:23.121] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid:236263] stopping ... [2023-02-21 11:19:23.121] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid | xargs kill -9; kill -9 -236263 [2023-02-21 11:19:23.182] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.184] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 11:19:24.184] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:24.207] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.208] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:24.269] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.269] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -f /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:19:24.328] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.328] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy is stopped [2023-02-21 11:19:24.409] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 11:19:24.409] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 11:19:24.409] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Call obagent-py_script_stop-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:19:24.409] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 11:19:24.410] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 11:19:24.411] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [INFO] Stop obagent [2023-02-21 11:19:24.412] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:19:24.437] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.437] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/115347 [2023-02-21 11:19:24.497] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.498] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent[pid:115347] stopping ... [2023-02-21 11:19:24.498] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: kill -9 115347 [2023-02-21 11:19:24.557] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.557] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:19:24.581] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.581] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/22398 [2023-02-21 11:19:24.642] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.643] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent[pid:22398] stopping ... [2023-02-21 11:19:24.643] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: kill -9 22398 [2023-02-21 11:19:24.703] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.703] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:19:24.727] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.727] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/207205 [2023-02-21 11:19:24.789] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:24.789] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent[pid:207205] stopping ... [2023-02-21 11:19:24.789] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: kill -9 207205 [2023-02-21 11:19:24.848] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:25.850] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) check whether the port is released [2023-02-21 11:19:25.850] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:25.877] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:25.877] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:25.942] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:25.942] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:19:26.002] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:26.003] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent is stopped [2023-02-21 11:19:26.003] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) check whether the port is released [2023-02-21 11:19:26.003] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:26.028] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:26.029] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:26.091] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:26.091] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:19:26.151] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:26.152] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent is stopped [2023-02-21 11:19:26.152] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) check whether the port is released [2023-02-21 11:19:26.152] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:26.183] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:26.183] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:26.254] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:26.254] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:19:26.314] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:26.315] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent is stopped [2023-02-21 11:19:26.368] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 11:19:26.368] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 11:19:26.368] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_stop-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:19:26.368] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 11:19:26.369] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 11:19:26.370] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [INFO] Stop prometheus [2023-02-21 11:19:26.370] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:19:26.391] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:26.391] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/236687 [2023-02-21 11:19:26.450] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:26.450] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/236687/fd [2023-02-21 11:19:26.511] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:26.511] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus[pid:236687] stopping... [2023-02-21 11:19:26.511] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheusd.pid | xargs kill -9; kill -9 236687 [2023-02-21 11:19:26.572] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:27.574] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 11:19:27.574] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:27.601] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:27.602] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -f /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:19:27.662] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:27.662] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus is stopped [2023-02-21 11:19:27.674] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 11:19:27.674] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 11:19:27.674] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Call grafana-py_script_stop-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:19:27.675] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - import stop [2023-02-21 11:19:27.676] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - add stop ref count to 1 [2023-02-21 11:19:27.677] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [INFO] Stop grafana [2023-02-21 11:19:27.677] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 11:19:27.721] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:27.722] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/236936 [2023-02-21 11:19:27.781] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:27.781] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/236936/fd [2023-02-21 11:19:27.839] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:27.839] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana[pid:236936] stopping... [2023-02-21 11:19:27.840] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: kill -9 236936 [2023-02-21 11:19:27.897] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:28.898] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- 10.253.208.63 check whether the port is released [2023-02-21 11:19:28.899] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:19:28.925] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:19:28.925] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana is stopped [2023-02-21 11:19:28.981] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - sub stop ref count to 0 [2023-02-21 11:19:28.981] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - export stop [2023-02-21 11:19:28.982] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - Set observer deploy status to stopped [2023-02-21 11:19:28.982] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 11:19:28.988] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [INFO] observer stopped [2023-02-21 11:19:28.988] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 11:19:28.988] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 11:19:28.988] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 11:19:28.989] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 11:19:28.989] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 11:19:28.989] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:19:28.989] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:19:28.989] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:19:28.989] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:19:28.989] [86e5712c-b196-11ed-8d22-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:19:41.509] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:19:41.510] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:19:41.510] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:19:41.510] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:19:41.510] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2023-02-21 11:19:41.510] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:19:41.510] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:19:41.510] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:19:41.511] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:19:41.511] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:19:41.525] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 11:19:41.526] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [ERROR] [ERROR] Deploy need reload. [2023-02-21 11:19:41.526] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [ERROR] Use `obd cluster reload observer` to make changes take effect. [2023-02-21 11:19:41.526] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [ERROR] If you still need to start the cluster, use the `obd cluster start observer --wop` option to start the cluster without loading parameters. [2023-02-21 11:19:41.526] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 11:19:41.526] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:19:41.526] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:19:41.526] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:19:41.526] [94a012d6-b196-11ed-ba01-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:20:59.342] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:20:59.343] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:20:59.343] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:20:59.343] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:20:59.343] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - opts: {} [2023-02-21 11:20:59.343] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:20:59.343] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:20:59.344] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:20:59.344] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:20:59.344] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:20:59.396] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - allow include file not exists [2023-02-21 11:20:59.396] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Load /home/admin/.obd/cluster/observer/tmp_config.yaml [2023-02-21 11:20:59.396] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 11:20:59.396] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:20:59.397] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:20:59.397] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 11:20:59.399] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:20:59.399] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 11:20:59.401] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:20:59.401] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 11:20:59.404] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:20:59.404] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 11:20:59.406] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:20:59.406] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 11:20:59.409] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [INFO] Search param plugin and load [2023-02-21 11:20:59.409] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:20:59.410] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 11:20:59.410] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:21:00.144] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:21:00.145] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:21:00.327] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Search param plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:21:00.327] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:21:00.423] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:21:00.423] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:21:00.444] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Search param plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:21:00.445] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:21:00.607] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Get environment variable EDITOR=vi [2023-02-21 11:21:00.607] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Create tmp yaml file [2023-02-21 11:21:00.609] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - vi /tmp/tmp_d938eg0.yaml [2023-02-21 11:21:17.704] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Load /tmp/tmp_d938eg0.yaml [2023-02-21 11:21:17.748] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Configure component change check [2023-02-21 11:21:17.749] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Information check for the configuration component. [2023-02-21 11:21:17.750] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [INFO] Search param plugin and load [2023-02-21 11:21:17.882] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [INFO] Parameter check [2023-02-21 11:21:17.886] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - server1(10.253.208.65) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:21:17.886] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - server2(10.253.208.67) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:21:17.887] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - server3(10.253.208.172) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:21:17.887] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - 10.253.208.63 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 param check [2023-02-21 11:21:17.888] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - server1(10.253.208.65) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:21:17.888] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - server2(10.253.208.67) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:21:17.888] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - server3(10.253.208.172) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:21:17.888] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - 10.253.208.63 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 param check [2023-02-21 11:21:17.889] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - 10.253.208.63 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 param check [2023-02-21 11:21:18.013] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - configure change check [2023-02-21 11:21:18.015] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Set deploy configuration status to DeployConfigStatus.UNCHNAGE [2023-02-21 11:21:18.016] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - Save new configuration yaml file [2023-02-21 11:21:18.016] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 2 [2023-02-21 11:21:18.016] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/observer [2023-02-21 11:21:18.016] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - copy /tmp/tmp_d938eg0.yaml /home/admin/.obd/cluster/observer/config.yaml [2023-02-21 11:21:18.031] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 11:21:18.037] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [INFO] Save deploy "observer" configuration [2023-02-21 11:21:18.040] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 1 [2023-02-21 11:21:18.040] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 11:21:18.040] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 11:21:18.040] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 11:21:18.040] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 11:21:18.040] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 11:21:18.040] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:21:18.041] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:21:18.041] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:21:18.041] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:21:18.041] [c3048d1e-b196-11ed-a57e-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:27:53.784] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:27:53.785] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:27:53.785] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:27:53.785] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:27:53.785] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - opts: {'force_kill': None} [2023-02-21 11:27:53.785] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:27:53.786] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:27:53.786] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:27:53.786] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:27:53.786] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:27:53.797] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Get deploy configuration [2023-02-21 11:27:53.841] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - allow include file not exists [2023-02-21 11:27:53.842] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 11:27:53.842] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 11:27:53.843] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:27:53.843] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:27:53.843] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 11:27:53.846] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:27:53.846] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 11:27:53.848] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:27:53.849] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 11:27:53.851] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:27:53.851] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 11:27:53.854] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:27:53.854] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 11:27:53.973] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Check deploy status [2023-02-21 11:27:53.973] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 11:27:53.973] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 11:27:53.974] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 11:27:53.974] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:27:53.975] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:27:54.682] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 11:27:54.682] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:27:54.682] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:27:54.849] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 11:27:54.849] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 11:27:54.850] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:27:54.947] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 11:27:54.947] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 11:27:54.947] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:27:54.970] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 11:27:54.970] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 11:27:54.970] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:27:55.002] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] Search plugins [2023-02-21 11:27:55.003] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching destroy plugin for components ... [2023-02-21 11:27:55.003] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching destroy plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:27:55.004] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_destroy-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:27:55.004] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching destroy plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:27:55.004] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_destroy-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:27:55.004] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching destroy plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:27:55.005] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_destroy-0.1 for obagent-1.2.0 [2023-02-21 11:27:55.005] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching destroy plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:27:55.005] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_destroy-2.37.1 for prometheus-2.37.1 [2023-02-21 11:27:55.005] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching destroy plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:27:55.005] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_destroy-7.5.17 for grafana-7.5.17 [2023-02-21 11:27:55.134] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 11:27:56.439] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] Cluster status check [2023-02-21 11:27:56.443] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching status plugin for components ... [2023-02-21 11:27:56.443] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching status plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:27:56.444] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:27:56.444] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching status plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:27:56.444] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:27:56.444] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching status plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:27:56.445] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_status-0.1 for obagent-1.2.0 [2023-02-21 11:27:56.445] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching status plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:27:56.445] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_status-2.37.1 for prometheus-2.37.1 [2023-02-21 11:27:56.445] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Searching status plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:27:56.445] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_status-7.5.17 for grafana-7.5.17 [2023-02-21 11:27:56.445] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:27:56.446] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:27:56.447] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:27:56.447] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:27:56.613] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:27:56.614] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:27:56.614] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] [2023-02-21 11:27:56.614] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:27:56.650] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:27:56.650] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:27:56.650] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] [2023-02-21 11:27:56.651] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:27:56.686] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:27:56.686] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:27:56.687] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] [2023-02-21 11:27:56.687] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:27:56.687] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:27:56.687] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:27:56.687] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:27:56.688] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:27:56.688] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:27:56.713] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:27:56.714] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 11:27:56.714] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] [2023-02-21 11:27:56.714] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:27:56.714] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:27:56.714] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Call obagent-py_script_status-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:27:56.715] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:27:56.715] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:27:56.716] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:27:56.739] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:27:56.739] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 11:27:56.739] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] [2023-02-21 11:27:56.740] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:27:56.760] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:27:56.760] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 11:27:56.760] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] [2023-02-21 11:27:56.760] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:27:56.793] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:27:56.794] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 11:27:56.794] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] [2023-02-21 11:27:56.794] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:27:56.794] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:27:56.794] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_status-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:27:56.794] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:27:56.795] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:27:56.795] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:27:56.817] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:27:56.817] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] cat: /data/obdata/prometheus/run/prometheus.pid: 没有那个文件或目录 [2023-02-21 11:27:56.817] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] [2023-02-21 11:27:56.817] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:27:56.817] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:27:56.817] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Call grafana-py_script_status-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:27:56.817] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:27:56.818] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:27:56.818] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 11:27:56.878] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:56.879] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/236936 [2023-02-21 11:27:56.939] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 11:27:56.940] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/236936: 没有那个文件或目录 [2023-02-21 11:27:56.940] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] [2023-02-21 11:27:56.940] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:27:56.940] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:27:56.962] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_destroy-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:27:56.962] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - import destroy [2023-02-21 11:27:56.963] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - add destroy ref count to 1 [2023-02-21 11:27:56.963] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] observer work dir cleaning [2023-02-21 11:27:56.964] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) work path cleaning [2023-02-21 11:27:56.964] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -fr /home/admin/observer/ [2023-02-21 11:27:57.045] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.046] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65):/home/admin/observer cleaned [2023-02-21 11:27:57.046] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -fr /topevery/obdata/ [2023-02-21 11:27:57.123] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:27:57.123] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] rm: 无法删除"/topevery/obdata/": 权限不够 [2023-02-21 11:27:57.123] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] [2023-02-21 11:27:57.123] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [WARNING] [WARN] OBD-1003: Fail to clean server1(10.253.208.65):/topevery/obdata [2023-02-21 11:27:57.123] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -fr /topevery/obdata/redo/ [2023-02-21 11:27:57.184] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.184] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65):/topevery/obdata/redo cleaned [2023-02-21 11:27:57.184] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) work path cleaning [2023-02-21 11:27:57.184] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -fr /home/admin/observer/ [2023-02-21 11:27:57.262] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.262] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67):/home/admin/observer cleaned [2023-02-21 11:27:57.262] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -fr /data/obdata/ [2023-02-21 11:27:57.412] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.412] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67):/data/obdata cleaned [2023-02-21 11:27:57.412] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -fr /data/obdata/redo/ [2023-02-21 11:27:57.471] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.472] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67):/data/obdata/redo cleaned [2023-02-21 11:27:57.472] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) work path cleaning [2023-02-21 11:27:57.472] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -fr /home/admin/observer/ [2023-02-21 11:27:57.583] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.584] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172):/home/admin/observer cleaned [2023-02-21 11:27:57.584] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -fr /data/obdata/ [2023-02-21 11:27:57.673] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.673] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172):/data/obdata cleaned [2023-02-21 11:27:57.673] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -fr /data/obdata/redo/ [2023-02-21 11:27:57.740] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.740] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172):/data/obdata/redo cleaned [2023-02-21 11:27:57.747] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] [WARN] OBD-1003: Fail to clean server1(10.253.208.65):/topevery/obdata [2023-02-21 11:27:57.747] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] [2023-02-21 11:27:57.747] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - sub destroy ref count to 0 [2023-02-21 11:27:57.748] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - export destroy [2023-02-21 11:27:57.748] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_destroy-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:27:57.748] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - import destroy [2023-02-21 11:27:57.749] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - add destroy ref count to 1 [2023-02-21 11:27:57.749] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] obproxy work dir cleaning [2023-02-21 11:27:57.750] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- 10.253.208.63 work path cleaning [2023-02-21 11:27:57.750] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -fr /data/obdata/obproxy/ [2023-02-21 11:27:57.776] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.776] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- 10.253.208.63:/data/obdata/obproxy cleaned [2023-02-21 11:27:57.881] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - sub destroy ref count to 0 [2023-02-21 11:27:57.881] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - export destroy [2023-02-21 11:27:57.881] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Call obagent-py_script_destroy-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:27:57.881] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - import destroy [2023-02-21 11:27:57.882] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - add destroy ref count to 1 [2023-02-21 11:27:57.882] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] obagent work dir cleaning [2023-02-21 11:27:57.885] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) work path cleaning [2023-02-21 11:27:57.885] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: rm -fr /home/admin/obagent/ [2023-02-21 11:27:57.939] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.939] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65):/home/admin/obagent cleaned [2023-02-21 11:27:57.939] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) work path cleaning [2023-02-21 11:27:57.940] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: rm -fr /home/admin/obagent/ [2023-02-21 11:27:57.980] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:57.981] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67):/home/admin/obagent cleaned [2023-02-21 11:27:57.981] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) work path cleaning [2023-02-21 11:27:57.981] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: rm -fr /home/admin/obagent/ [2023-02-21 11:27:58.034] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:58.034] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172):/home/admin/obagent cleaned [2023-02-21 11:27:58.144] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - sub destroy ref count to 0 [2023-02-21 11:27:58.144] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - export destroy [2023-02-21 11:27:58.144] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_destroy-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:27:58.144] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - import destroy [2023-02-21 11:27:58.145] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - add destroy ref count to 1 [2023-02-21 11:27:58.145] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] prometheus work dir cleaning [2023-02-21 11:27:58.146] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- 10.253.208.63 work path cleaning [2023-02-21 11:27:58.146] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -fr /data/obdata/prometheus [2023-02-21 11:27:58.244] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:58.244] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- 10.253.208.63:/data/obdata/prometheus cleaned [2023-02-21 11:27:58.244] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -fr /data/obdata/prometheus/data [2023-02-21 11:27:58.303] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:58.303] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- 10.253.208.63:/data/obdata/prometheus/data cleaned [2023-02-21 11:27:58.409] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - sub destroy ref count to 0 [2023-02-21 11:27:58.409] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - export destroy [2023-02-21 11:27:58.409] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Call grafana-py_script_destroy-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:27:58.409] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - import destroy [2023-02-21 11:27:58.410] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - add destroy ref count to 1 [2023-02-21 11:27:58.410] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] grafana work dir cleaning [2023-02-21 11:27:58.411] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- 10.253.208.63 work path cleaning [2023-02-21 11:27:58.411] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: rm -fr /data/obdata/grafana [2023-02-21 11:27:58.520] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:27:58.520] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] -- 10.253.208.63:/data/obdata/grafana cleaned [2023-02-21 11:27:58.542] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - sub destroy ref count to 0 [2023-02-21 11:27:58.542] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - export destroy [2023-02-21 11:27:58.542] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - Set observer deploy status to destroyed [2023-02-21 11:27:58.542] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 11:27:58.548] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [INFO] observer destroyed [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:27:58.551] [ba0b5d4a-b197-11ed-b688-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:31:01.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:31:01.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:31:01.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:31:01.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:31:01.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - opts: {'config': 'all-components.yaml', 'force': None, 'clean': False, 'unuselibrepo': None, 'auto_create_tenant': None, 'force_delete': None, 'strict_check': None} [2023-02-21 11:31:01.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:31:01.437] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:31:01.437] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:31:01.437] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:31:01.437] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:31:01.440] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Create deploy by configuration path [2023-02-21 11:31:01.440] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 2 [2023-02-21 11:31:01.440] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/observer [2023-02-21 11:31:01.440] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - copy all-components.yaml /home/admin/.obd/cluster/observer/config.yaml [2023-02-21 11:31:01.444] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get deploy configuration [2023-02-21 11:31:01.492] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search best suitable repository [2023-02-21 11:31:01.492] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search package for components... [2023-02-21 11:31:01.492] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get oceanbase-ce repository [2023-02-21 11:31:01.493] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 11:31:01.493] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:01.493] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:31:01.493] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 11:31:01.493] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2023-02-21 11:31:01.499] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:01.499] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 11:31:01.501] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search oceanbase-ce package from mirror [2023-02-21 11:31:01.502] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/mirror [2023-02-21 11:31:01.502] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/mirror/remote [2023-02-21 11:31:01.502] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/mirror/local [2023-02-21 11:31:01.502] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:31:01.502] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 11:31:01.502] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 11:31:01.503] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:01.503] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - open /home/admin/.obd/mirror/remote/OceanBase.repo for r [2023-02-21 11:31:01.504] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 11:31:01.504] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:01.504] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is oceanbase-ce [2023-02-21 11:31:01.504] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:01.504] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:01.504] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: oceanbase-ce [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: oceanbase-ce [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: oceanbase-ce [2023-02-21 11:31:01.505] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1d56dc742f5f05a2d15797d291b51a94019e728d as same as oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d, Use package name: oceanbase-ce [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get obproxy-ce repository [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 11:31:01.506] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2023-02-21 11:31:01.511] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:01.511] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 11:31:01.513] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search obproxy-ce package from mirror [2023-02-21 11:31:01.513] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 11:31:01.513] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 11:31:01.513] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 6 [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is obproxy-ce [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: obproxy-ce [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0 [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:5.el7 [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: obproxy-ce [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0 [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:5.el7 [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: obproxy-ce [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0 [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:5.el7 [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: de53232a951184fad75b15884458d85e31d2f6c3 as same as obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3, Use package name: obproxy-ce [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0 [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:5.el7 [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get obagent repository [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository obagent version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 11:31:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obagent [2023-02-21 11:31:01.518] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:01.518] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 6 [2023-02-21 11:31:01.520] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search obagent package from mirror [2023-02-21 11:31:01.520] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 7 [2023-02-21 11:31:01.520] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 8 [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 9 [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is obagent [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: obagent [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 1.2.0 [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:4.el7 [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: obagent [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 1.2.0 [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:4.el7 [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.521] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: obagent [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 1.2.0 [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:4.el7 [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e as same as obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e, Use package name: obagent [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 1.2.0 [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:4.el7 [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get prometheus repository [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository prometheus version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:01.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 7 [2023-02-21 11:31:01.523] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/prometheus [2023-02-21 11:31:01.525] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:01.525] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 8 [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search prometheus package from mirror [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 10 [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 11 [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 12 [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is prometheus [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:01.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: prometheus [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 2.37.1 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:10000102022110211.el7 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: prometheus [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 2.37.1 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:10000102022110211.el7 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: prometheus [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 2.37.1 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:10000102022110211.el7 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 as same as prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263, Use package name: prometheus [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 2.37.1 [2023-02-21 11:31:01.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:10000102022110211.el7 [2023-02-21 11:31:01.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:01.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get grafana repository [2023-02-21 11:31:01.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository grafana version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:01.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 9 [2023-02-21 11:31:01.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/grafana [2023-02-21 11:31:01.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:01.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 10 [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search grafana package from mirror [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 13 [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 14 [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 15 [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is grafana [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: grafana [2023-02-21 11:31:01.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 7.5.17 [2023-02-21 11:31:01.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:1 [2023-02-21 11:31:01.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:01.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: grafana [2023-02-21 11:31:01.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 7.5.17 [2023-02-21 11:31:01.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:1 [2023-02-21 11:31:01.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:01.539] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: grafana [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 7.5.17 [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:1 [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 as same as grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, Use package name: grafana [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 7.5.17 [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:1 [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching install plugin for components ... [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching install plugin for components ... [2023-02-21 11:31:01.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for oceanbase-ce [2023-02-21 11:31:01.541] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 11:31:01.541] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-install-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:01.541] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for obproxy-ce [2023-02-21 11:31:01.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-install-3.2.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:01.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for obagent [2023-02-21 11:31:01.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-install-0.1 for obagent-1.2.0 [2023-02-21 11:31:01.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for prometheus [2023-02-21 11:31:01.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-install-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:01.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for grafana [2023-02-21 11:31:01.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-install-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:01.543] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install oceanbase-ce-4.0.0.0 for local [2023-02-21 11:31:01.674] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:01.674] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: 4.0.0.0, tag: oceanbase-ce, release: None, package_hash: None [2023-02-21 11:31:01.674] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:01.675] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 11 [2023-02-21 11:31:01.675] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:01.675] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install obproxy-ce-4.0.0 for local [2023-02-21 11:31:01.806] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:01.806] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: obproxy-ce, release: None, package_hash: None [2023-02-21 11:31:01.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:01.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 12 [2023-02-21 11:31:01.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:01.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install obagent-1.2.0 for local [2023-02-21 11:31:01.938] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:01.938] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository obagent version: 1.2.0, tag: obagent, release: None, package_hash: None [2023-02-21 11:31:01.939] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:01.939] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 13 [2023-02-21 11:31:01.939] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:01.939] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install prometheus-2.37.1 for local [2023-02-21 11:31:02.070] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:02.071] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository prometheus version: 2.37.1, tag: prometheus, release: None, package_hash: None [2023-02-21 11:31:02.071] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:02.071] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 14 [2023-02-21 11:31:02.071] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:02.071] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install grafana-7.5.17 for local [2023-02-21 11:31:02.202] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:02.203] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository grafana version: 7.5.17, tag: grafana, release: None, package_hash: None [2023-02-21 11:31:02.203] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:02.203] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 15 [2023-02-21 11:31:02.203] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:02.211] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Cluster param config check [2023-02-21 11:31:02.212] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 11:31:02.212] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 11:31:02.213] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:02.213] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:03.444] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 11:31:03.445] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:03.445] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:03.744] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 11:31:03.744] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 11:31:03.744] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:03.923] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 11:31:03.923] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:03.923] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:03.963] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 11:31:03.963] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:03.964] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:04.022] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server1(10.253.208.65) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:31:04.023] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server2(10.253.208.67) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:31:04.023] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server3(10.253.208.172) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:31:04.023] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.63 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 param check [2023-02-21 11:31:04.024] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server1(10.253.208.65) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:31:04.024] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server2(10.253.208.67) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:31:04.024] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server3(10.253.208.172) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:31:04.024] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.63 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 param check [2023-02-21 11:31:04.024] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.63 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 param check [2023-02-21 11:31:04.141] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 11:31:05.447] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching generate_config plugin for components ... [2023-02-21 11:31:05.447] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching generate_config plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:05.448] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_generate_config-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:05.449] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching generate_config plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:05.449] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_generate_config-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:05.449] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching generate_config plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:05.449] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_generate_config-0.1 for obagent-1.2.0 [2023-02-21 11:31:05.449] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching generate_config plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:05.449] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_generate_config-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:05.449] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching generate_config plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:05.450] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_generate_config-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:05.450] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_generate_config-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:05.450] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import generate_config [2023-02-21 11:31:05.453] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add generate_config ref count to 1 [2023-02-21 11:31:05.453] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Generate observer configuration [2023-02-21 11:31:05.454] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/net/dev [2023-02-21 11:31:05.491] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:05.492] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ping -W 1 -c 1 -I eth0 10.253.208.65 [2023-02-21 11:31:06.562] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:06.562] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:06.563] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: grep -e 'processor\s*:' /proc/cpuinfo | wc -l [2023-02-21 11:31:06.627] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:06.628] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/net/dev [2023-02-21 11:31:06.663] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:06.663] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ping -W 1 -c 1 -I eth0 10.253.208.67 [2023-02-21 11:31:07.730] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:07.730] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:07.730] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: grep -e 'processor\s*:' /proc/cpuinfo | wc -l [2023-02-21 11:31:07.792] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:07.793] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/net/dev [2023-02-21 11:31:07.816] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:07.817] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ping -W 1 -c 1 -I eth0 10.253.208.172 [2023-02-21 11:31:08.882] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:08.882] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:08.883] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: grep -e 'processor\s*:' /proc/cpuinfo | wc -l [2023-02-21 11:31:08.950] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:08.975] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub generate_config ref count to 0 [2023-02-21 11:31:08.975] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export generate_config [2023-02-21 11:31:08.976] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_generate_config-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:08.976] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import generate_config [2023-02-21 11:31:08.977] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add generate_config ref count to 1 [2023-02-21 11:31:08.977] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Generate obproxy configuration [2023-02-21 11:31:08.978] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - open /home/admin/.obd/cluster/observer/inner_config.yaml for w [2023-02-21 11:31:09.108] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub generate_config ref count to 0 [2023-02-21 11:31:09.109] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export generate_config [2023-02-21 11:31:09.109] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obagent-py_script_generate_config-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:09.109] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import generate_config [2023-02-21 11:31:09.110] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add generate_config ref count to 1 [2023-02-21 11:31:09.110] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Generate obagent configuration [2023-02-21 11:31:09.243] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub generate_config ref count to 0 [2023-02-21 11:31:09.243] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export generate_config [2023-02-21 11:31:09.243] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_generate_config-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:09.243] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import generate_config [2023-02-21 11:31:09.244] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add generate_config ref count to 1 [2023-02-21 11:31:09.244] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Generate prometheus configuration [2023-02-21 11:31:09.376] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub generate_config ref count to 0 [2023-02-21 11:31:09.376] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export generate_config [2023-02-21 11:31:09.376] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call grafana-py_script_generate_config-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:09.377] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import generate_config [2023-02-21 11:31:09.377] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add generate_config ref count to 1 [2023-02-21 11:31:09.378] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Generate grafana configuration [2023-02-21 11:31:09.509] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub generate_config ref count to 0 [2023-02-21 11:31:09.509] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export generate_config [2023-02-21 11:31:09.510] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - open /home/admin/.obd/cluster/observer/inner_config.yaml for w [2023-02-21 11:31:09.531] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:31:09.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 3 [2023-02-21 11:31:09.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get deploy info [2023-02-21 11:31:09.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - judge deploy status [2023-02-21 11:31:09.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - config path is None or not [2023-02-21 11:31:09.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get deploy configuration [2023-02-21 11:31:09.584] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search best suitable repository [2023-02-21 11:31:09.584] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search package for components... [2023-02-21 11:31:09.584] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get oceanbase-ce repository [2023-02-21 11:31:09.584] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:09.589] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:09.589] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 16 [2023-02-21 11:31:09.589] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search oceanbase-ce package from mirror [2023-02-21 11:31:09.589] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 16 [2023-02-21 11:31:09.589] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 17 [2023-02-21 11:31:09.589] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 18 [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is oceanbase-ce [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: oceanbase-ce [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: oceanbase-ce [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: oceanbase-ce [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1d56dc742f5f05a2d15797d291b51a94019e728d as same as oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d, Use package name: oceanbase-ce [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get obproxy-ce repository [2023-02-21 11:31:09.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:09.596] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:09.596] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 17 [2023-02-21 11:31:09.596] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search obproxy-ce package from mirror [2023-02-21 11:31:09.596] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 19 [2023-02-21 11:31:09.596] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 20 [2023-02-21 11:31:09.596] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:09.596] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 21 [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is obproxy-ce [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: obproxy-ce [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0 [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:5.el7 [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: obproxy-ce [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0 [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:5.el7 [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.597] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: obproxy-ce [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0 [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:5.el7 [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: de53232a951184fad75b15884458d85e31d2f6c3 as same as obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3, Use package name: obproxy-ce [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0 [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:5.el7 [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get obagent repository [2023-02-21 11:31:09.598] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository obagent version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:09.601] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:09.601] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 18 [2023-02-21 11:31:09.601] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search obagent package from mirror [2023-02-21 11:31:09.601] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 22 [2023-02-21 11:31:09.601] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 23 [2023-02-21 11:31:09.601] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:09.601] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 24 [2023-02-21 11:31:09.601] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:09.601] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is obagent [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: obagent [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 1.2.0 [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:4.el7 [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: obagent [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 1.2.0 [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:4.el7 [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:09.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: obagent [2023-02-21 11:31:09.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 1.2.0 [2023-02-21 11:31:09.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:4.el7 [2023-02-21 11:31:09.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e as same as obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e, Use package name: obagent [2023-02-21 11:31:09.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 1.2.0 [2023-02-21 11:31:09.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:4.el7 [2023-02-21 11:31:09.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:09.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get prometheus repository [2023-02-21 11:31:09.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository prometheus version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:09.605] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:09.605] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 19 [2023-02-21 11:31:09.605] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search prometheus package from mirror [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 25 [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 26 [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 27 [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is prometheus [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: prometheus [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 2.37.1 [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:10000102022110211.el7 [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:09.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: prometheus [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 2.37.1 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:10000102022110211.el7 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: prometheus [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 2.37.1 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:10000102022110211.el7 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 as same as prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263, Use package name: prometheus [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 2.37.1 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:10000102022110211.el7 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get grafana repository [2023-02-21 11:31:09.607] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository grafana version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:09.610] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:09.610] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 20 [2023-02-21 11:31:09.610] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search grafana package from mirror [2023-02-21 11:31:09.610] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 28 [2023-02-21 11:31:09.610] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 29 [2023-02-21 11:31:09.610] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:09.610] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 30 [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is grafana [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: grafana [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 7.5.17 [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:1 [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: grafana [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 7.5.17 [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:1 [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: grafana [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 7.5.17 [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:1 [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 as same as grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, Use package name: grafana [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 7.5.17 [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:1 [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching install plugin for components ... [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching install plugin for components ... [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for oceanbase-ce [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-install-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:09.614] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for obproxy-ce [2023-02-21 11:31:09.615] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-install-3.2.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:09.615] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for obagent [2023-02-21 11:31:09.615] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-install-0.1 for obagent-1.2.0 [2023-02-21 11:31:09.615] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for prometheus [2023-02-21 11:31:09.615] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-install-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:09.615] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for grafana [2023-02-21 11:31:09.615] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-install-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:09.616] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install oceanbase-ce-4.0.0.0 for local [2023-02-21 11:31:09.747] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:09.747] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: 4.0.0.0, tag: oceanbase-ce, release: None, package_hash: None [2023-02-21 11:31:09.747] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:09.747] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 21 [2023-02-21 11:31:09.747] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:09.748] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install obproxy-ce-4.0.0 for local [2023-02-21 11:31:09.879] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:09.879] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: obproxy-ce, release: None, package_hash: None [2023-02-21 11:31:09.879] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:09.879] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 22 [2023-02-21 11:31:09.879] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:09.880] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install obagent-1.2.0 for local [2023-02-21 11:31:10.011] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:10.011] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository obagent version: 1.2.0, tag: obagent, release: None, package_hash: None [2023-02-21 11:31:10.011] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:10.011] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 23 [2023-02-21 11:31:10.011] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:10.012] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install prometheus-2.37.1 for local [2023-02-21 11:31:10.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:10.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository prometheus version: 2.37.1, tag: prometheus, release: None, package_hash: None [2023-02-21 11:31:10.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:10.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 24 [2023-02-21 11:31:10.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:10.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install grafana-7.5.17 for local [2023-02-21 11:31:10.275] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:10.275] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository grafana version: 7.5.17, tag: grafana, release: None, package_hash: None [2023-02-21 11:31:10.275] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:10.275] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 25 [2023-02-21 11:31:10.275] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:10.275] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching install plugin for components ... [2023-02-21 11:31:10.275] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for oceanbase-ce [2023-02-21 11:31:10.276] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-install-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:10.276] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for obproxy-ce [2023-02-21 11:31:10.276] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-install-3.2.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:10.276] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for obagent [2023-02-21 11:31:10.276] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-install-0.1 for obagent-1.2.0 [2023-02-21 11:31:10.276] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for prometheus [2023-02-21 11:31:10.276] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-install-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:10.276] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for grafana [2023-02-21 11:31:10.276] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-install-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:10.278] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +--------------------------------------------------------------------------------------------+ [2023-02-21 11:31:10.278] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | Packages | [2023-02-21 11:31:10.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +--------------+---------+------------------------+------------------------------------------+ [2023-02-21 11:31:10.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | Repository | Version | Release | Md5 | [2023-02-21 11:31:10.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +--------------+---------+------------------------+------------------------------------------+ [2023-02-21 11:31:10.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | oceanbase-ce | 4.0.0.0 | 103000022023011215.el7 | 1d56dc742f5f05a2d15797d291b51a94019e728d | [2023-02-21 11:31:10.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | obproxy-ce | 4.0.0 | 5.el7 | de53232a951184fad75b15884458d85e31d2f6c3 | [2023-02-21 11:31:10.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | obagent | 1.2.0 | 4.el7 | 0e8f5ee68c337ea28514c9f3f820ea546227fa7e | [2023-02-21 11:31:10.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | prometheus | 2.37.1 | 10000102022110211.el7 | 58913c7606f05feb01bc1c6410346e5fc31cf263 | [2023-02-21 11:31:10.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | grafana | 7.5.17 | 1 | 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 | [2023-02-21 11:31:10.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +--------------+---------+------------------------+------------------------------------------+ [2023-02-21 11:31:10.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Repository integrity check [2023-02-21 11:31:10.410] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Parameter check [2023-02-21 11:31:10.412] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 11:31:10.412] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 11:31:10.412] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:10.412] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:10.413] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 11:31:10.413] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:10.413] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:10.413] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 11:31:10.413] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 11:31:10.413] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:10.413] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 11:31:10.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:10.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:10.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 11:31:10.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:10.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:10.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Cluster param configuration check [2023-02-21 11:31:10.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server1(10.253.208.65) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:31:10.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server2(10.253.208.67) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:31:10.415] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server3(10.253.208.172) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:31:10.415] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.63 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 param check [2023-02-21 11:31:10.415] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server1(10.253.208.65) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:31:10.415] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server2(10.253.208.67) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:31:10.415] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - server3(10.253.208.172) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:31:10.415] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.63 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 param check [2023-02-21 11:31:10.416] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.63 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 param check [2023-02-21 11:31:10.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 11:31:11.722] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Cluster status check [2023-02-21 11:31:11.723] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching status plugin for components ... [2023-02-21 11:31:11.723] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching status plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:11.724] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:11.724] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching status plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:11.724] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:11.724] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching status plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:11.725] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_status-0.1 for obagent-1.2.0 [2023-02-21 11:31:11.725] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching status plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:11.725] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_status-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:11.725] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching status plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:11.725] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_status-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:11.726] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:11.726] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:31:11.726] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:31:11.727] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:11.759] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:11.760] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:31:11.760] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:11.760] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:11.792] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:11.792] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:31:11.792] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:11.793] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:11.817] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:11.817] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:31:11.818] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:11.818] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:31:11.818] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:31:11.818] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:11.818] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:31:11.819] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:31:11.819] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:31:11.843] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:11.843] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 11:31:11.844] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:11.844] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:31:11.844] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:31:11.844] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obagent-py_script_status-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:11.844] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:31:11.845] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:31:11.845] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:31:11.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:11.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 11:31:11.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:11.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:31:11.890] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:11.890] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 11:31:11.890] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:11.890] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:31:11.915] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:11.915] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 11:31:11.915] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:11.916] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:31:11.916] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:31:11.916] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_status-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:11.916] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:31:11.916] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:31:11.917] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:31:11.937] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:11.937] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /data/obdata/prometheus/run/prometheus.pid: 没有那个文件或目录 [2023-02-21 11:31:11.937] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:11.937] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:31:11.937] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:31:11.937] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call grafana-py_script_status-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:11.938] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:31:11.938] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:31:11.938] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 11:31:11.996] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:11.996] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /data/obdata/grafana/run/grafana.pid: 没有那个文件或目录 [2023-02-21 11:31:11.996] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:11.996] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:31:11.996] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:31:12.114] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search init plugin [2023-02-21 11:31:12.114] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching init plugin for components ... [2023-02-21 11:31:12.114] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching init plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:12.115] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_init-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:12.115] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching init plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:12.115] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_init-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:12.115] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching init plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:12.115] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_init-0.1 for obagent-1.2.0 [2023-02-21 11:31:12.115] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching init plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:12.116] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_init-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:12.116] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching init plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:12.116] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_init-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:12.116] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Exec oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d init plugin [2023-02-21 11:31:12.116] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Apply oceanbase-ce-py_script_init-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:12.116] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import init [2023-02-21 11:31:12.118] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add init ref count to 1 [2023-02-21 11:31:12.118] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- option `force` is None [2023-02-21 11:31:12.119] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Initializes observer work home [2023-02-21 11:31:12.119] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:12.140] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.140] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) initializes observer work home [2023-02-21 11:31:12.141] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/observer [2023-02-21 11:31:12.203] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.204] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /home/admin/observer [2023-02-21 11:31:12.266] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.267] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c "mkdir -p /home/admin/observer/{etc,admin,.conf,log,bin,lib}" [2023-02-21 11:31:12.331] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.331] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /topevery/obdata [2023-02-21 11:31:12.394] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.394] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /topevery/obdata [2023-02-21 11:31:12.457] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.457] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c "mkdir -p /topevery/obdata/sstable" [2023-02-21 11:31:12.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: if [ ! '/topevery/obdata' -ef '/home/admin/observer/store' ]; then ln -sf /topevery/obdata /home/admin/observer/store; fi [2023-02-21 11:31:12.586] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.587] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /topevery/obdata/redo/clog [2023-02-21 11:31:12.649] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.650] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /topevery/obdata/redo/clog [2023-02-21 11:31:12.711] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.712] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /topevery/obdata/redo/clog [2023-02-21 11:31:12.774] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.774] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: if [ ! '/topevery/obdata/redo/clog' -ef '/topevery/obdata/clog' ]; then ln -sf /topevery/obdata/redo/clog /topevery/obdata/clog; fi [2023-02-21 11:31:12.836] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.837] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /topevery/obdata/slog [2023-02-21 11:31:12.899] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.899] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /topevery/obdata/slog [2023-02-21 11:31:12.960] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:12.960] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /topevery/obdata/slog [2023-02-21 11:31:13.021] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.022] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: if [ ! '/topevery/obdata/slog' -ef '/topevery/obdata/slog' ]; then ln -sf /topevery/obdata/slog /topevery/obdata/slog; fi [2023-02-21 11:31:13.082] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.082] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- check slog dir in the same disk with data dir [2023-02-21 11:31:13.082] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: df --block-size=1024 /topevery/obdata/slog | awk 'NR == 2 { print $1 }' [2023-02-21 11:31:13.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.144] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- slog disk is /dev/mapper/mongo-mongo [2023-02-21 11:31:13.144] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: df --block-size=1024 /topevery/obdata | awk 'NR == 2 { print $1 }' [2023-02-21 11:31:13.206] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.206] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- data disk is /dev/mapper/mongo-mongo [2023-02-21 11:31:13.206] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:13.227] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.227] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) initializes observer work home [2023-02-21 11:31:13.228] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/observer [2023-02-21 11:31:13.288] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.289] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /home/admin/observer [2023-02-21 11:31:13.348] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.348] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c "mkdir -p /home/admin/observer/{etc,admin,.conf,log,bin,lib}" [2023-02-21 11:31:13.408] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.409] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /data/obdata [2023-02-21 11:31:13.470] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.470] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /data/obdata [2023-02-21 11:31:13.531] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c "mkdir -p /data/obdata/sstable" [2023-02-21 11:31:13.593] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.594] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: if [ ! '/data/obdata' -ef '/home/admin/observer/store' ]; then ln -sf /data/obdata /home/admin/observer/store; fi [2023-02-21 11:31:13.653] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.654] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /data/obdata/redo/clog [2023-02-21 11:31:13.715] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.715] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /data/obdata/redo/clog [2023-02-21 11:31:13.775] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.776] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /data/obdata/redo/clog [2023-02-21 11:31:13.836] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.836] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: if [ ! '/data/obdata/redo/clog' -ef '/data/obdata/clog' ]; then ln -sf /data/obdata/redo/clog /data/obdata/clog; fi [2023-02-21 11:31:13.897] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.897] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /data/obdata/slog [2023-02-21 11:31:13.956] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:13.956] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /data/obdata/slog [2023-02-21 11:31:14.015] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.015] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /data/obdata/slog [2023-02-21 11:31:14.075] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.075] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: if [ ! '/data/obdata/slog' -ef '/data/obdata/slog' ]; then ln -sf /data/obdata/slog /data/obdata/slog; fi [2023-02-21 11:31:14.134] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.135] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- check slog dir in the same disk with data dir [2023-02-21 11:31:14.135] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: df --block-size=1024 /data/obdata/slog | awk 'NR == 2 { print $1 }' [2023-02-21 11:31:14.196] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.196] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- slog disk is /dev/sdb1 [2023-02-21 11:31:14.197] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: df --block-size=1024 /data/obdata | awk 'NR == 2 { print $1 }' [2023-02-21 11:31:14.256] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.257] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- data disk is /dev/sdb1 [2023-02-21 11:31:14.257] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:14.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) initializes observer work home [2023-02-21 11:31:14.280] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/observer [2023-02-21 11:31:14.342] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.342] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /home/admin/observer [2023-02-21 11:31:14.404] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.404] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c "mkdir -p /home/admin/observer/{etc,admin,.conf,log,bin,lib}" [2023-02-21 11:31:14.467] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /data/obdata [2023-02-21 11:31:14.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /data/obdata [2023-02-21 11:31:14.589] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.589] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c "mkdir -p /data/obdata/sstable" [2023-02-21 11:31:14.651] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.652] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: if [ ! '/data/obdata' -ef '/home/admin/observer/store' ]; then ln -sf /data/obdata /home/admin/observer/store; fi [2023-02-21 11:31:14.713] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.714] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /data/obdata/redo/clog [2023-02-21 11:31:14.774] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.774] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /data/obdata/redo/clog [2023-02-21 11:31:14.835] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.836] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /data/obdata/redo/clog [2023-02-21 11:31:14.896] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.897] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: if [ ! '/data/obdata/redo/clog' -ef '/data/obdata/clog' ]; then ln -sf /data/obdata/redo/clog /data/obdata/clog; fi [2023-02-21 11:31:14.960] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:14.961] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /data/obdata/slog [2023-02-21 11:31:15.026] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.026] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /data/obdata/slog [2023-02-21 11:31:15.091] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.091] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /data/obdata/slog [2023-02-21 11:31:15.154] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.154] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: if [ ! '/data/obdata/slog' -ef '/data/obdata/slog' ]; then ln -sf /data/obdata/slog /data/obdata/slog; fi [2023-02-21 11:31:15.215] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.215] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- check slog dir in the same disk with data dir [2023-02-21 11:31:15.215] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: df --block-size=1024 /data/obdata/slog | awk 'NR == 2 { print $1 }' [2023-02-21 11:31:15.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- slog disk is /dev/mapper/topevery-topevery [2023-02-21 11:31:15.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: df --block-size=1024 /data/obdata | awk 'NR == 2 { print $1 }' [2023-02-21 11:31:15.344] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.344] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- data disk is /dev/mapper/topevery-topevery [2023-02-21 11:31:15.377] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub init ref count to 0 [2023-02-21 11:31:15.378] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export init [2023-02-21 11:31:15.378] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Exec obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 init plugin [2023-02-21 11:31:15.378] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Apply obproxy-ce-py_script_init-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:15.378] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import init [2023-02-21 11:31:15.379] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add init ref count to 1 [2023-02-21 11:31:15.379] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Initializes obproxy work home [2023-02-21 11:31:15.380] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:15.399] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.399] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 init cluster work home [2023-02-21 11:31:15.400] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'mkdir -p /data/obdata/obproxy/{run,bin,lib}' [2023-02-21 11:31:15.467] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.511] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub init ref count to 0 [2023-02-21 11:31:15.512] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export init [2023-02-21 11:31:15.512] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Exec obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e init plugin [2023-02-21 11:31:15.512] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Apply obagent-py_script_init-0.1 for obagent-1.2.0 [2023-02-21 11:31:15.512] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import init [2023-02-21 11:31:15.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add init ref count to 1 [2023-02-21 11:31:15.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Initializes obagent work home [2023-02-21 11:31:15.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:15.543] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.544] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) init cluster work home [2023-02-21 11:31:15.544] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent [2023-02-21 11:31:15.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.606] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /home/admin/obagent [2023-02-21 11:31:15.669] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.669] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'mkdir -p /home/admin/obagent/{run,bin,lib,conf,log}' [2023-02-21 11:31:15.734] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.735] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:15.755] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.755] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) init cluster work home [2023-02-21 11:31:15.755] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent [2023-02-21 11:31:15.816] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.816] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /home/admin/obagent [2023-02-21 11:31:15.875] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.875] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'mkdir -p /home/admin/obagent/{run,bin,lib,conf,log}' [2023-02-21 11:31:15.939] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.939] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:15.964] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:15.965] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) init cluster work home [2023-02-21 11:31:15.965] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent [2023-02-21 11:31:16.032] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.032] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /home/admin/obagent [2023-02-21 11:31:16.099] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.100] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'mkdir -p /home/admin/obagent/{run,bin,lib,conf,log}' [2023-02-21 11:31:16.170] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.298] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub init ref count to 0 [2023-02-21 11:31:16.298] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export init [2023-02-21 11:31:16.298] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Exec prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 init plugin [2023-02-21 11:31:16.298] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Apply prometheus-py_script_init-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:16.298] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import init [2023-02-21 11:31:16.299] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add init ref count to 1 [2023-02-21 11:31:16.300] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Initializes prometheus work home [2023-02-21 11:31:16.300] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus [2023-02-21 11:31:16.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.324] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus [2023-02-21 11:31:16.384] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.385] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus/data [2023-02-21 11:31:16.443] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.444] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/data [2023-02-21 11:31:16.503] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.503] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: if [ ! '/data/obdata/prometheus/data' -ef '/data/obdata/prometheus/data' ]; then ln -sf /data/obdata/prometheus/data /data/obdata/prometheus/data; fi [2023-02-21 11:31:16.561] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.562] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub init ref count to 0 [2023-02-21 11:31:16.562] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export init [2023-02-21 11:31:16.562] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Exec grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 init plugin [2023-02-21 11:31:16.562] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Apply grafana-py_script_init-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:16.563] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import init [2023-02-21 11:31:16.564] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add init ref count to 1 [2023-02-21 11:31:16.565] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Initializes grafana work home [2023-02-21 11:31:16.567] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 init grafana work home [2023-02-21 11:31:16.567] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c "mkdir -p /data/obdata/grafana/{run,conf}" [2023-02-21 11:31:16.623] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.624] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/data [2023-02-21 11:31:16.685] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.685] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/grafana/data [2023-02-21 11:31:16.747] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.747] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: if [ ! '/data/obdata/grafana/data' -ef '/data/obdata/grafana/data' ]; then ln -sf /data/obdata/grafana/data /data/obdata/grafana/data; fi [2023-02-21 11:31:16.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/data/log [2023-02-21 11:31:16.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.869] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/grafana/data/log [2023-02-21 11:31:16.929] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.929] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: if [ ! '/data/obdata/grafana/data/log' -ef '/data/obdata/grafana/data/log' ]; then ln -sf /data/obdata/grafana/data/log /data/obdata/grafana/data/log; fi [2023-02-21 11:31:16.988] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:16.989] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/data/plugins [2023-02-21 11:31:17.050] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.050] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/grafana/data/plugins [2023-02-21 11:31:17.109] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.110] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: if [ ! '/data/obdata/grafana/data/plugins' -ef '/data/obdata/grafana/data/plugins' ]; then ln -sf /data/obdata/grafana/data/plugins /data/obdata/grafana/data/plugins; fi [2023-02-21 11:31:17.167] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.168] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning [2023-02-21 11:31:17.227] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.227] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/grafana/conf/provisioning [2023-02-21 11:31:17.288] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.288] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: if [ ! '/data/obdata/grafana/conf/provisioning' -ef '/data/obdata/grafana/conf/provisioning' ]; then ln -sf /data/obdata/grafana/conf/provisioning /data/obdata/grafana/conf/provisioning; fi [2023-02-21 11:31:17.346] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.346] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c "mkdir -p /data/obdata/grafana/conf/provisioning/dashboards/templates" [2023-02-21 11:31:17.408] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.488] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 11:31:17.489] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards/templates && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/templates/oceanbase-metrics_rev1.json [2023-02-21 11:31:17.510] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.510] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/grafana/7.5.17/oceanbase-metrics_rev1.json to /data/obdata/grafana/conf/provisioning/dashboards/templates/oceanbase-metrics_rev1.json [2023-02-21 11:31:17.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/grafana/conf/provisioning/dashboards/templates/oceanbase-metrics_rev1.json [2023-02-21 11:31:17.625] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:31:17.626] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ln -s /data/obdata/grafana/data/log /data/obdata/grafana/log [2023-02-21 11:31:17.690] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.740] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub init ref count to 0 [2023-02-21 11:31:17.740] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export init [2023-02-21 11:31:17.741] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import install_repo [2023-02-21 11:31:17.743] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add install_repo ref count to 1 [2023-02-21 11:31:17.744] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository install [2023-02-21 11:31:17.745] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- Remote oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository integrity check [2023-02-21 11:31:17.745] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository integrity check [2023-02-21 11:31:17.745] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:17.768] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.768] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/.data [2023-02-21 11:31:17.831] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.832] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d install check [2023-02-21 11:31:17.835] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d has installed [2023-02-21 11:31:17.835] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env _repo_dir to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d' [2023-02-21 11:31:17.835] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env _home_path to '/home/admin/observer' [2023-02-21 11:31:17.835] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:17.904] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.905] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin/observer' [2023-02-21 11:31:17.905] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/observer/bin/observer' [2023-02-21 11:31:17.905] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ln -fs ${source} ${target} [2023-02-21 11:31:17.968] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:17.969] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin' [2023-02-21 11:31:17.969] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/observer/bin' [2023-02-21 11:31:17.969] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls -1 ${source} [2023-02-21 11:31:18.032] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.032] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:18.099] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.100] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:18.165] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.166] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/etc' [2023-02-21 11:31:18.166] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/observer/etc' [2023-02-21 11:31:18.166] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls -1 ${source} [2023-02-21 11:31:18.228] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.229] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:18.311] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.312] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:18.378] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.378] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/admin' [2023-02-21 11:31:18.379] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/observer/admin' [2023-02-21 11:31:18.379] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls -1 ${source} [2023-02-21 11:31:18.442] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.443] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:18.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.523] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:18.588] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.588] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository integrity check [2023-02-21 11:31:18.589] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:18.610] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.610] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/.data [2023-02-21 11:31:18.670] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.670] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d install check [2023-02-21 11:31:18.673] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d has installed [2023-02-21 11:31:18.673] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env _repo_dir to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d' [2023-02-21 11:31:18.673] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env _home_path to '/home/admin/observer' [2023-02-21 11:31:18.673] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:18.738] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.739] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin/observer' [2023-02-21 11:31:18.739] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/observer/bin/observer' [2023-02-21 11:31:18.739] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ln -fs ${source} ${target} [2023-02-21 11:31:18.803] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.803] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin' [2023-02-21 11:31:18.803] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/observer/bin' [2023-02-21 11:31:18.804] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls -1 ${source} [2023-02-21 11:31:18.866] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.866] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:18.933] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:18.934] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:19.000] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.000] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/etc' [2023-02-21 11:31:19.000] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/observer/etc' [2023-02-21 11:31:19.000] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls -1 ${source} [2023-02-21 11:31:19.061] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.061] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:19.190] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.191] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:19.253] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.253] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/admin' [2023-02-21 11:31:19.253] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/observer/admin' [2023-02-21 11:31:19.254] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls -1 ${source} [2023-02-21 11:31:19.315] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.316] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:19.398] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.399] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:19.460] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.460] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository integrity check [2023-02-21 11:31:19.460] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:19.482] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.482] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/.data [2023-02-21 11:31:19.541] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d install check [2023-02-21 11:31:19.544] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d has installed [2023-02-21 11:31:19.545] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env _repo_dir to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d' [2023-02-21 11:31:19.545] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env _home_path to '/home/admin/observer' [2023-02-21 11:31:19.545] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:19.611] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.612] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin/observer' [2023-02-21 11:31:19.612] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/observer/bin/observer' [2023-02-21 11:31:19.612] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ln -fs ${source} ${target} [2023-02-21 11:31:19.673] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.673] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/bin' [2023-02-21 11:31:19.673] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/observer/bin' [2023-02-21 11:31:19.673] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls -1 ${source} [2023-02-21 11:31:19.733] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.734] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:19.797] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.797] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:19.859] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.860] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/etc' [2023-02-21 11:31:19.860] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/observer/etc' [2023-02-21 11:31:19.861] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls -1 ${source} [2023-02-21 11:31:19.921] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:19.922] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:20.006] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.006] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:20.072] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.073] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/oceanbase-ce/4.0.0.0/1d56dc742f5f05a2d15797d291b51a94019e728d/admin' [2023-02-21 11:31:20.073] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/observer/admin' [2023-02-21 11:31:20.073] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls -1 ${source} [2023-02-21 11:31:20.137] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.137] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:20.219] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.220] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:20.286] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.361] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check [2023-02-21 11:31:20.361] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check [2023-02-21 11:31:20.361] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:31:20.361] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ldd /home/admin/observer/bin/observer [2023-02-21 11:31:20.395] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.396] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:20.396] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check [2023-02-21 11:31:20.396] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:31:20.396] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ldd /home/admin/observer/bin/observer [2023-02-21 11:31:20.423] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.424] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:20.424] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check [2023-02-21 11:31:20.425] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:31:20.425] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ldd /home/admin/observer/bin/observer [2023-02-21 11:31:20.455] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.456] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:20.492] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub install_repo ref count to 0 [2023-02-21 11:31:20.492] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export install_repo [2023-02-21 11:31:20.492] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 repository install [2023-02-21 11:31:20.493] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- Remote obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 repository integrity check [2023-02-21 11:31:20.493] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 repository integrity check [2023-02-21 11:31:20.493] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:20.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /home/admin/.obd/repository/obproxy-ce/4.0.0/de53232a951184fad75b15884458d85e31d2f6c3/.data [2023-02-21 11:31:20.574] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.574] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 install check [2023-02-21 11:31:20.576] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 has installed [2023-02-21 11:31:20.577] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env _repo_dir to '/home/admin/.obd/repository/obproxy-ce/4.0.0/de53232a951184fad75b15884458d85e31d2f6c3' [2023-02-21 11:31:20.577] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env _home_path to '/data/obdata/obproxy' [2023-02-21 11:31:20.577] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:20.639] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.640] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/obproxy-ce/4.0.0/de53232a951184fad75b15884458d85e31d2f6c3/bin/obproxy' [2023-02-21 11:31:20.640] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/obproxy/bin/obproxy' [2023-02-21 11:31:20.640] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ln -fs ${source} ${target} [2023-02-21 11:31:20.702] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.754] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 repository lib check [2023-02-21 11:31:20.757] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 repository lib check [2023-02-21 11:31:20.757] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/obproxy/lib:' [2023-02-21 11:31:20.757] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ldd /data/obdata/obproxy/bin/obproxy [2023-02-21 11:31:20.783] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.783] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:20.886] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository install [2023-02-21 11:31:20.886] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- Remote obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository integrity check [2023-02-21 11:31:20.887] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository integrity check [2023-02-21 11:31:20.887] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:20.908] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.908] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/.data [2023-02-21 11:31:20.970] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:20.970] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e install check [2023-02-21 11:31:20.973] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e has installed [2023-02-21 11:31:20.973] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env _repo_dir to '/home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e' [2023-02-21 11:31:20.973] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env _home_path to '/home/admin/obagent' [2023-02-21 11:31:20.973] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:21.044] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.044] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/bin/monagent' [2023-02-21 11:31:21.044] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/obagent/bin/monagent' [2023-02-21 11:31:21.045] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ln -fs ${source} ${target} [2023-02-21 11:31:21.105] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.105] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf' [2023-02-21 11:31:21.105] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/obagent/conf' [2023-02-21 11:31:21.105] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls -1 ${source} [2023-02-21 11:31:21.169] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.169] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:21.248] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.248] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:21.312] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.312] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository integrity check [2023-02-21 11:31:21.312] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:21.335] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.336] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/.data [2023-02-21 11:31:21.395] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.396] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e install check [2023-02-21 11:31:21.398] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e has installed [2023-02-21 11:31:21.398] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env _repo_dir to '/home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e' [2023-02-21 11:31:21.398] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env _home_path to '/home/admin/obagent' [2023-02-21 11:31:21.399] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:21.467] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.467] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/bin/monagent' [2023-02-21 11:31:21.467] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/obagent/bin/monagent' [2023-02-21 11:31:21.467] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ln -fs ${source} ${target} [2023-02-21 11:31:21.528] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf' [2023-02-21 11:31:21.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/obagent/conf' [2023-02-21 11:31:21.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls -1 ${source} [2023-02-21 11:31:21.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.592] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:21.708] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.709] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:21.770] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.771] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository integrity check [2023-02-21 11:31:21.771] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:21.793] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.794] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/.data [2023-02-21 11:31:21.855] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.856] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e install check [2023-02-21 11:31:21.858] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e has installed [2023-02-21 11:31:21.858] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env _repo_dir to '/home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e' [2023-02-21 11:31:21.858] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env _home_path to '/home/admin/obagent' [2023-02-21 11:31:21.859] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:21.929] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.930] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/bin/monagent' [2023-02-21 11:31:21.930] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/obagent/bin/monagent' [2023-02-21 11:31:21.931] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ln -fs ${source} ${target} [2023-02-21 11:31:21.997] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:21.998] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf' [2023-02-21 11:31:21.998] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/obagent/conf' [2023-02-21 11:31:21.998] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls -1 ${source} [2023-02-21 11:31:22.064] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.065] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:22.152] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.152] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:22.219] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.321] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository lib check [2023-02-21 11:31:22.322] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository lib check [2023-02-21 11:31:22.325] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/obagent/lib:' [2023-02-21 11:31:22.325] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ldd /home/admin/obagent/bin/monagent [2023-02-21 11:31:22.357] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.357] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:22.357] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository lib check [2023-02-21 11:31:22.358] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/obagent/lib:' [2023-02-21 11:31:22.358] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ldd /home/admin/obagent/bin/monagent [2023-02-21 11:31:22.382] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.382] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:22.382] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e repository lib check [2023-02-21 11:31:22.383] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/obagent/lib:' [2023-02-21 11:31:22.383] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ldd /home/admin/obagent/bin/monagent [2023-02-21 11:31:22.415] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.415] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:22.453] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository install [2023-02-21 11:31:22.454] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- Remote prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository integrity check [2023-02-21 11:31:22.454] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository integrity check [2023-02-21 11:31:22.454] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:22.474] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.475] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /home/admin/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263/.data [2023-02-21 11:31:22.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 install check [2023-02-21 11:31:22.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 has installed [2023-02-21 11:31:22.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env _repo_dir to '/home/admin/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263' [2023-02-21 11:31:22.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env _home_path to '/data/obdata/prometheus' [2023-02-21 11:31:22.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:22.599] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.599] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263/prometheus' [2023-02-21 11:31:22.600] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/prometheus/prometheus' [2023-02-21 11:31:22.600] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ln -fs ${source} ${target} [2023-02-21 11:31:22.659] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.659] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263/promtool' [2023-02-21 11:31:22.659] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/prometheus/promtool' [2023-02-21 11:31:22.659] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ln -fs ${source} ${target} [2023-02-21 11:31:22.717] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.718] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263/consoles' [2023-02-21 11:31:22.718] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/prometheus/consoles' [2023-02-21 11:31:22.718] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -1 ${source} [2023-02-21 11:31:22.777] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.777] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:22.874] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.875] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:22.935] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.936] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/prometheus/2.37.1/58913c7606f05feb01bc1c6410346e5fc31cf263/console_libraries' [2023-02-21 11:31:22.936] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/prometheus/console_libraries' [2023-02-21 11:31:22.936] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -1 ${source} [2023-02-21 11:31:22.995] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:22.995] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:23.069] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:23.070] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:23.131] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:23.237] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository lib check [2023-02-21 11:31:23.238] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository lib check [2023-02-21 11:31:23.238] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/prometheus/lib:' [2023-02-21 11:31:23.238] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:23.369] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository install [2023-02-21 11:31:23.369] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- Remote grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository integrity check [2023-02-21 11:31:23.370] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository integrity check [2023-02-21 11:31:23.370] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:23.390] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:23.390] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /home/admin/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/.data [2023-02-21 11:31:23.449] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:23.450] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 install check [2023-02-21 11:31:23.454] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 has installed [2023-02-21 11:31:23.455] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env _repo_dir to '/home/admin/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6' [2023-02-21 11:31:23.455] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env _home_path to '/data/obdata/grafana' [2023-02-21 11:31:23.455] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:24.126] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:24.127] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/bin/grafana-server' [2023-02-21 11:31:24.128] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/grafana/bin/grafana-server' [2023-02-21 11:31:24.128] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ln -fs ${source} ${target} [2023-02-21 11:31:24.189] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:24.190] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/bin' [2023-02-21 11:31:24.190] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/grafana/bin' [2023-02-21 11:31:24.190] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -1 ${source} [2023-02-21 11:31:24.253] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:24.253] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type f | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:24.317] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:24.317] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type l | xargs -i ln -fs ${source}/{} ${target}/{} [2023-02-21 11:31:24.378] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:24.379] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/public' [2023-02-21 11:31:24.379] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/grafana/public' [2023-02-21 11:31:24.379] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -1 ${source} [2023-02-21 11:31:24.438] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:24.439] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:38.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:38.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:38.549] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:38.549] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/plugins-bundled' [2023-02-21 11:31:38.550] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/grafana/plugins-bundled' [2023-02-21 11:31:38.550] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -1 ${source} [2023-02-21 11:31:38.609] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:38.610] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:38.716] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:38.717] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:38.779] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:38.779] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/scripts' [2023-02-21 11:31:38.780] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/grafana/scripts' [2023-02-21 11:31:38.780] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -1 ${source} [2023-02-21 11:31:38.841] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:38.842] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:39.015] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.015] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:39.078] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.079] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env source to '/home/admin/.obd/repository/grafana/7.5.17/1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6/conf' [2023-02-21 11:31:39.079] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env target to '/data/obdata/grafana/conf' [2023-02-21 11:31:39.079] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -1 ${source} [2023-02-21 11:31:39.140] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.141] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type f | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:39.243] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.244] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd ${source} && find -type l | xargs -i cp -f ${source}/{} ${target}/{} [2023-02-21 11:31:39.305] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.413] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository lib check [2023-02-21 11:31:39.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository lib check [2023-02-21 11:31:39.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/grafana/lib:' [2023-02-21 11:31:39.414] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ldd /data/obdata/grafana/bin/grafana-server [2023-02-21 11:31:39.440] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.440] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:39.545] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Try to get lib-repository [2023-02-21 11:31:39.556] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search best suitable repository libs [2023-02-21 11:31:39.556] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search package for components... [2023-02-21 11:31:39.556] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get oceanbase-ce-libs repository [2023-02-21 11:31:39.556] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce-libs version: None, tag: None, release: None, package_hash: None [2023-02-21 11:31:39.556] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 26 [2023-02-21 11:31:39.556] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce-libs [2023-02-21 11:31:39.565] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 [2023-02-21 11:31:39.565] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 27 [2023-02-21 11:31:39.569] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search oceanbase-ce-libs package from mirror [2023-02-21 11:31:39.569] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 31 [2023-02-21 11:31:39.570] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 32 [2023-02-21 11:31:39.570] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - load repo config: /home/admin/.obd/mirror/remote/OceanBase.repo [2023-02-21 11:31:39.570] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/mirror_and_repo`, count 33 [2023-02-21 11:31:39.570] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - md5 is None [2023-02-21 11:31:39.570] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name is oceanbase-ce-libs [2023-02-21 11:31:39.570] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - release is None [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - version is None [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: oceanbase-ce-libs [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: ef48cff7633e3dbc39f5c0abdcd72348213e09a2 [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get RPM package by name: oceanbase-ce-libs [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:39.571] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: ef48cff7633e3dbc39f5c0abdcd72348213e09a2 [2023-02-21 11:31:39.572] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found Package oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 [2023-02-21 11:31:39.572] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: oceanbase-ce-libs [2023-02-21 11:31:39.572] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:39.572] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:39.572] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:39.572] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: ef48cff7633e3dbc39f5c0abdcd72348213e09a2 as same as oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2, Use package name: oceanbase-ce-libs [2023-02-21 11:31:39.572] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] version: 4.0.0.0 [2023-02-21 11:31:39.573] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] release:103000022023011215.el7 [2023-02-21 11:31:39.573] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] arch: x86_64 [2023-02-21 11:31:39.573] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] md5: ef48cff7633e3dbc39f5c0abdcd72348213e09a2 [2023-02-21 11:31:39.573] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching install plugin for components ... [2023-02-21 11:31:39.573] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching install plugin for components ... [2023-02-21 11:31:39.573] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search install plugin for oceanbase-ce-libs [2023-02-21 11:31:39.573] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-libs-install-3.1.0 for oceanbase-ce-libs-4.0.0.0 [2023-02-21 11:31:39.574] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] install oceanbase-ce-libs-4.0.0.0 for local [2023-02-21 11:31:39.705] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - get head repository [2023-02-21 11:31:39.706] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce-libs version: 4.0.0.0, tag: oceanbase-ce-libs, release: None, package_hash: None [2023-02-21 11:31:39.708] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 [2023-02-21 11:31:39.708] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 28 [2023-02-21 11:31:39.708] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - head repository: oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 [2023-02-21 11:31:39.710] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 repository install [2023-02-21 11:31:39.711] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- Remote oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 repository integrity check [2023-02-21 11:31:39.711] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 repository integrity check [2023-02-21 11:31:39.711] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:39.735] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.736] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/.data [2023-02-21 11:31:39.799] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.800] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 install check [2023-02-21 11:31:39.804] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 has installed [2023-02-21 11:31:39.804] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env _repo_dir to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2' [2023-02-21 11:31:39.804] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env _home_path to '/home/admin/observer/lib' [2023-02-21 11:31:39.804] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:39.865] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.866] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so' [2023-02-21 11:31:39.866] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/observer/lib/libaio.so' [2023-02-21 11:31:39.866] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ln -fs ${source} ${target} [2023-02-21 11:31:39.927] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.928] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1' [2023-02-21 11:31:39.928] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/observer/lib/libaio.so.1' [2023-02-21 11:31:39.928] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ln -fs ${source} ${target} [2023-02-21 11:31:39.991] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:39.992] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1.0.1' [2023-02-21 11:31:39.992] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/observer/lib/libaio.so.1.0.1' [2023-02-21 11:31:39.992] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.056] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.056] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so' [2023-02-21 11:31:40.057] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/observer/lib/libmariadb.so' [2023-02-21 11:31:40.057] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.119] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.120] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so.3' [2023-02-21 11:31:40.120] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env target to '/home/admin/observer/lib/libmariadb.so.3' [2023-02-21 11:31:40.120] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.183] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.183] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 repository integrity check [2023-02-21 11:31:40.184] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:40.207] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.208] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/.data [2023-02-21 11:31:40.269] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.270] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 install check [2023-02-21 11:31:40.273] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 has installed [2023-02-21 11:31:40.273] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env _repo_dir to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2' [2023-02-21 11:31:40.273] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env _home_path to '/home/admin/observer/lib' [2023-02-21 11:31:40.273] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:40.335] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.336] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so' [2023-02-21 11:31:40.336] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/observer/lib/libaio.so' [2023-02-21 11:31:40.336] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.398] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.398] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1' [2023-02-21 11:31:40.398] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/observer/lib/libaio.so.1' [2023-02-21 11:31:40.399] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.459] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.459] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1.0.1' [2023-02-21 11:31:40.460] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/observer/lib/libaio.so.1.0.1' [2023-02-21 11:31:40.460] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.522] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so' [2023-02-21 11:31:40.523] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/observer/lib/libmariadb.so' [2023-02-21 11:31:40.523] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.583] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.583] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so.3' [2023-02-21 11:31:40.583] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env target to '/home/admin/observer/lib/libmariadb.so.3' [2023-02-21 11:31:40.584] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.644] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.644] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 repository integrity check [2023-02-21 11:31:40.644] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: echo ${OBD_HOME:-"$HOME"}/.obd [2023-02-21 11:31:40.668] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.668] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/.data [2023-02-21 11:31:40.731] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.731] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 install check [2023-02-21 11:31:40.734] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) oceanbase-ce-libs-4.0.0.0-103000022023011215.el7-ef48cff7633e3dbc39f5c0abdcd72348213e09a2 has installed [2023-02-21 11:31:40.734] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env _repo_dir to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2' [2023-02-21 11:31:40.734] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env _home_path to '/home/admin/observer/lib' [2023-02-21 11:31:40.734] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p ${_home_path} && cd ${_repo_dir} && find -type d | xargs -i mkdir -p ${_home_path}/{} [2023-02-21 11:31:40.798] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.799] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so' [2023-02-21 11:31:40.799] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/observer/lib/libaio.so' [2023-02-21 11:31:40.799] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.861] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.862] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1' [2023-02-21 11:31:40.862] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/observer/lib/libaio.so.1' [2023-02-21 11:31:40.862] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.924] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.925] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libaio.so.1.0.1' [2023-02-21 11:31:40.925] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/observer/lib/libaio.so.1.0.1' [2023-02-21 11:31:40.925] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ln -fs ${source} ${target} [2023-02-21 11:31:40.987] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:40.987] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so' [2023-02-21 11:31:40.987] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/observer/lib/libmariadb.so' [2023-02-21 11:31:40.987] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ln -fs ${source} ${target} [2023-02-21 11:31:41.052] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:41.053] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env source to '/home/admin/.obd/repository/oceanbase-ce-libs/4.0.0.0/ef48cff7633e3dbc39f5c0abdcd72348213e09a2/libmariadb.so.3' [2023-02-21 11:31:41.053] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env target to '/home/admin/observer/lib/libmariadb.so.3' [2023-02-21 11:31:41.053] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ln -fs ${source} ${target} [2023-02-21 11:31:41.120] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:41.145] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Remote oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check [2023-02-21 11:31:41.146] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check [2023-02-21 11:31:41.146] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:31:41.146] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ldd /home/admin/observer/bin/observer [2023-02-21 11:31:41.175] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:41.176] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:41.176] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check [2023-02-21 11:31:41.176] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:31:41.176] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ldd /home/admin/observer/bin/observer [2023-02-21 11:31:41.202] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:41.203] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:41.204] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d repository lib check [2023-02-21 11:31:41.204] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:31:41.204] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ldd /home/admin/observer/bin/observer [2023-02-21 11:31:41.236] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:41.237] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '' [2023-02-21 11:31:41.278] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import rsync [2023-02-21 11:31:41.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add rsync ref count to 1 [2023-02-21 11:31:41.279] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub rsync ref count to 0 [2023-02-21 11:31:41.280] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export rsync [2023-02-21 11:31:41.280] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 11:31:41.288] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - open /home/admin/.obd/cluster/observer/inner_config.yaml for w [2023-02-21 11:31:41.316] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] observer deployed [2023-02-21 11:31:41.316] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:31:41.316] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 4 [2023-02-21 11:31:41.329] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 11:31:41.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 11:31:41.331] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:41.331] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: 4.0.0.0, tag: 1d56dc742f5f05a2d15797d291b51a94019e728d, release: None, package_hash: None [2023-02-21 11:31:41.331] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:41.331] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:41.331] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: de53232a951184fad75b15884458d85e31d2f6c3, release: None, package_hash: None [2023-02-21 11:31:41.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:41.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:41.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository obagent version: 1.2.0, tag: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e, release: None, package_hash: None [2023-02-21 11:31:41.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:41.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:41.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository prometheus version: 2.37.1, tag: 58913c7606f05feb01bc1c6410346e5fc31cf263, release: None, package_hash: None [2023-02-21 11:31:41.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:41.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:41.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search repository grafana version: 7.5.17, tag: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, release: None, package_hash: None [2023-02-21 11:31:41.333] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:41.461] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 11:31:41.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Search plugins [2023-02-21 11:31:41.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start_check plugin for components ... [2023-02-21 11:31:41.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:41.531] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:41.531] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:41.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:41.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:41.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start_check-1.1.1 for obagent-1.2.0 [2023-02-21 11:31:41.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start_check plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:41.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:41.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start_check plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:41.533] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start_check-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:41.533] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 11:31:41.533] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:41.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:41.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:41.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:41.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:41.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 11:31:41.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:41.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:41.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:41.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:41.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 11:31:41.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:41.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:41.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:41.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:41.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:41.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 11:31:41.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:41.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:41.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:41.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:41.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 11:31:41.537] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:41.538] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:41.538] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:41.538] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:41.538] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:41.538] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 11:31:41.538] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:41.538] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:41.538] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:41.539] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:41.539] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 11:31:41.539] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:41.539] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:41.539] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:41.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:41.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:41.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 11:31:41.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:41.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:41.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:41.540] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:41.662] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 11:31:42.836] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 11:31:42.837] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 11:31:42.837] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 11:31:42.838] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:31:42.838] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:42.838] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 11:31:42.838] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:31:42.838] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:42.839] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 11:31:42.839] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 11:31:42.839] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:42.839] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 11:31:42.839] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 11:31:42.840] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:42.840] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 11:31:42.840] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 11:31:42.840] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:42.968] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:42.968] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 11:31:42.974] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 11:31:42.975] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Check before start observer [2023-02-21 11:31:42.976] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:43.010] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:43.010] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:31:43.010] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:43.011] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) port check [2023-02-21 11:31:43.011] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:43.077] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.078] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:43.145] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.146] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /topevery/obdata/sstable/block_file [2023-02-21 11:31:43.207] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 11:31:43.207] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/topevery/obdata/sstable/block_file: 没有那个文件或目录 [2023-02-21 11:31:43.207] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:43.208] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: grep -e '^ *eth0:' /proc/net/dev [2023-02-21 11:31:43.268] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.269] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:43.301] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:43.302] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:31:43.302] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:43.302] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) port check [2023-02-21 11:31:43.302] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:43.368] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.369] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:43.433] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.434] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /data/obdata/sstable/block_file [2023-02-21 11:31:43.495] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 11:31:43.495] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/data/obdata/sstable/block_file: 没有那个文件或目录 [2023-02-21 11:31:43.495] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:43.496] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: grep -e '^ *eth0:' /proc/net/dev [2023-02-21 11:31:43.555] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.556] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:43.581] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:43.582] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:31:43.582] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:43.582] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) port check [2023-02-21 11:31:43.582] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:43.646] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.646] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:43.711] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.712] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /data/obdata/sstable/block_file [2023-02-21 11:31:43.774] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 11:31:43.775] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/data/obdata/sstable/block_file: 没有那个文件或目录 [2023-02-21 11:31:43.775] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:43.775] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: grep -e '^ *eth0:' /proc/net/dev [2023-02-21 11:31:43.837] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.838] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 11:31:43.859] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.859] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ulimit -a [2023-02-21 11:31:43.919] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.920] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.65) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:31:43.920] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /proc/meminfo [2023-02-21 11:31:43.981] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:43.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [WARNING] [WARN] OBD-2000: (10.253.208.65) not enough memory. (Free: 5.6G, Need: 10.0G) [2023-02-21 11:31:43.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: df --block-size=1024 [2023-02-21 11:31:44.046] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.047] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: df --block-size=1024 /topevery/obdata [2023-02-21 11:31:44.107] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.107] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: df --block-size=1024 /topevery/obdata/redo/clog [2023-02-21 11:31:44.167] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.168] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 51118387200, 'need': 0}, '/dev': {'total': 20979048448, 'avail': 20979048448, 'need': 0}, '/dev/shm': {'total': 20991266816, 'avail': 20991266816, 'need': 0}, '/run': {'total': 20991266816, 'avail': 20006924288, 'need': 0}, '/sys/fs/cgroup': {'total': 20991266816, 'avail': 20991266816, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 889667584, 'need': 0}, '/home': {'total': 44127686656, 'avail': 42916487168, 'need': 0}, '/topevery': {'total': 2113643364352, 'avail': 800261005312, 'need': 0}, '/run/user/0': {'total': 4198256640, 'avail': 4198256640, 'need': 0}, '/run/user/1001': {'total': 4198256640, 'avail': 4198256640, 'need': 0}} [2023-02-21 11:31:44.168] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [WARNING] [WARN] (10.253.208.65) clog and data use the same disk (/topevery) [2023-02-21 11:31:44.168] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 11:31:44.191] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.191] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ulimit -a [2023-02-21 11:31:44.252] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.252] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.67) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:31:44.252] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /proc/meminfo [2023-02-21 11:31:44.313] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.313] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: df --block-size=1024 [2023-02-21 11:31:44.379] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.380] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: df --block-size=1024 /data/obdata [2023-02-21 11:31:44.440] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.441] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: df --block-size=1024 /data/obdata/redo/clog [2023-02-21 11:31:44.503] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.504] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 50949165056, 'need': 0}, '/dev': {'total': 8296525824, 'avail': 8296525824, 'need': 0}, '/dev/shm': {'total': 8308740096, 'avail': 8308736000, 'need': 0}, '/run': {'total': 8308740096, 'avail': 7425093632, 'need': 0}, '/sys/fs/cgroup': {'total': 8308740096, 'avail': 8308740096, 'need': 0}, '/data': {'total': 211242950656, 'avail': 200425857024, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 889667584, 'need': 0}, '/home': {'total': 44127686656, 'avail': 42916081664, 'need': 0}, '/run/user/0': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1001': {'total': 1661751296, 'avail': 1661751296, 'need': 0}} [2023-02-21 11:31:44.504] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [WARNING] [WARN] (10.253.208.67) clog and data use the same disk (/data) [2023-02-21 11:31:44.504] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2023-02-21 11:31:44.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ulimit -a [2023-02-21 11:31:44.593] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.594] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [WARNING] [WARN] OBD-1007: (10.253.208.172) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:31:44.594] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /proc/meminfo [2023-02-21 11:31:44.660] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.660] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: df --block-size=1024 [2023-02-21 11:31:44.728] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.729] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: df --block-size=1024 /data/obdata [2023-02-21 11:31:44.797] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.797] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: df --block-size=1024 /data/obdata/redo/clog [2023-02-21 11:31:44.867] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- disk: {'/': {'total': 53660876800, 'avail': 41970544640, 'need': 0}, '/dev': {'total': 8291450880, 'avail': 8291450880, 'need': 0}, '/dev/shm': {'total': 8308744192, 'avail': 8308715520, 'need': 0}, '/run': {'total': 8308744192, 'avail': 8079032320, 'need': 0}, '/sys/fs/cgroup': {'total': 8308744192, 'avail': 8308744192, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 844517376, 'need': 0}, '/home': {'total': 48420556800, 'avail': 47205416960, 'need': 0}, '/data': {'total': 316924559360, 'avail': 300734918656, 'need': 0}, '/run/user/0': {'total': 1661751296, 'avail': 1661751296, 'need': 0}, '/run/user/1002': {'total': 1661751296, 'avail': 1661751296, 'need': 0}} [2023-02-21 11:31:44.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [WARNING] [WARN] (10.253.208.172) clog and data use the same disk (/data) [2023-02-21 11:31:44.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ping -W 1 -c 1 -I eth0 10.253.208.67 [2023-02-21 11:31:44.902] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.903] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ping -W 1 -c 1 -I eth0 10.253.208.172 [2023-02-21 11:31:44.969] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.970] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ping -W 1 -c 1 -I eth0 10.253.208.65 [2023-02-21 11:31:44.997] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:44.997] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ping -W 1 -c 1 -I eth0 10.253.208.172 [2023-02-21 11:31:45.062] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.063] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ping -W 1 -c 1 -I eth0 10.253.208.65 [2023-02-21 11:31:45.093] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.094] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ping -W 1 -c 1 -I eth0 10.253.208.67 [2023-02-21 11:31:45.164] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.165] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: date +%s%N [2023-02-21 11:31:45.188] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.188] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.65 time delta -1.70556640625 [2023-02-21 11:31:45.188] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: date +%s%N [2023-02-21 11:31:45.209] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.209] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.67 time delta -1.590576171875 [2023-02-21 11:31:45.209] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: date +%s%N [2023-02-21 11:31:45.237] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.237] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.172 time delta -1.566650390625 [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.65) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] [WARN] OBD-2000: (10.253.208.65) not enough memory. (Free: 5.6G, Need: 10.0G) [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] [WARN] (10.253.208.65) clog and data use the same disk (/topevery) [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.67) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] [WARN] (10.253.208.67) clog and data use the same disk (/data) [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] [WARN] OBD-1007: (10.253.208.172) The recommended number of max user processes is 12288 (Current value: 4096) [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] [WARN] (10.253.208.172) clog and data use the same disk (/data) [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:31:45.323] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 11:31:45.324] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 11:31:45.325] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Check before start obproxy [2023-02-21 11:31:45.326] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:31:45.349] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:45.350] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 11:31:45.350] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:45.350] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 11:31:45.350] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:45.415] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.416] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:45.481] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.587] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 11:31:45.587] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 11:31:45.588] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start_check-1.1.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:31:45.588] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 11:31:45.589] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 11:31:45.590] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Check before start obagent [2023-02-21 11:31:45.591] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:31:45.615] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:45.616] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 11:31:45.616] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:45.616] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) port check [2023-02-21 11:31:45.616] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:45.682] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.682] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:45.748] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.748] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:31:45.769] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:45.769] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 11:31:45.769] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:45.769] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) port check [2023-02-21 11:31:45.770] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:45.832] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.833] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:45.896] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.897] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:31:45.921] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:45.921] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 11:31:45.921] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:45.921] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) port check [2023-02-21 11:31:45.922] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:45.988] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:45.989] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:46.054] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:46.114] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 11:31:46.114] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 11:31:46.114] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:31:46.114] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 11:31:46.116] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 11:31:46.117] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Check before start prometheus [2023-02-21 11:31:46.118] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:31:46.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:46.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /data/obdata/prometheus/run/prometheus.pid: 没有那个文件或目录 [2023-02-21 11:31:46.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:46.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 11:31:46.143] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:46.210] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:46.249] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 11:31:46.250] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 11:31:46.250] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start_check-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:31:46.250] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 11:31:46.251] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 11:31:46.252] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Check before start grafana [2023-02-21 11:31:46.253] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 11:31:46.276] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:46.277] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /data/obdata/grafana/run/grafana.pid: 没有那个文件或目录 [2023-02-21 11:31:46.277] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:46.277] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 11:31:46.277] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:31:46.343] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:46.383] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 11:31:46.384] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 11:31:46.384] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:46.384] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import start [2023-02-21 11:31:46.386] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 11:31:46.386] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Start observer [2023-02-21 11:31:46.387] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:46.409] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:46.409] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:31:46.410] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:46.410] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) start command construction [2023-02-21 11:31:46.410] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:46.434] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:46.434] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:31:46.434] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:46.434] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) start command construction [2023-02-21 11:31:46.435] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:46.462] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:31:46.462] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 11:31:46.462] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:31:46.462] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) start command construction [2023-02-21 11:31:46.462] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- starting server1(10.253.208.65) observer [2023-02-21 11:31:46.463] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:31:46.463] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone1' -n 'obcluster' -c 1 -d '/topevery/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 11:31:46.644] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:46.645] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 delete env LD_LIBRARY_PATH [2023-02-21 11:31:46.645] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- starting server2(10.253.208.67) observer [2023-02-21 11:31:46.646] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:31:46.646] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone2' -n 'obcluster' -c 1 -d '/data/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 11:31:46.813] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:46.813] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 delete env LD_LIBRARY_PATH [2023-02-21 11:31:46.814] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- starting server3(10.253.208.172) observer [2023-02-21 11:31:46.814] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 11:31:46.814] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -r '10.253.208.65:2882:2881;10.253.208.67:2882:2881;10.253.208.172:2882:2881' -p 2881 -P 2882 -z 'zone3' -n 'obcluster' -c 1 -d '/data/obdata' -i 'eth0' -l 'ERROR' -o __min_full_resource_pool_memory=2147483648,memory_limit='10G',datafile_size='100G',log_disk_size='30G',enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4,skip_proxy_sys_private_check=True,enable_strict_kernel_release=False,system_memory='5G',cpu_count=16 [2023-02-21 11:31:47.867] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:47.867] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 delete env LD_LIBRARY_PATH [2023-02-21 11:31:47.952] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] observer program health check [2023-02-21 11:31:50.953] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 11:31:50.953] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:50.977] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:50.978] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/118859 [2023-02-21 11:31:51.042] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:51.042] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid: 118859] started [2023-02-21 11:31:51.042] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 11:31:51.042] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:51.069] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:51.069] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/25791 [2023-02-21 11:31:51.130] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:51.130] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid: 25791] started [2023-02-21 11:31:51.130] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 11:31:51.131] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:31:51.156] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:51.156] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/211348 [2023-02-21 11:31:51.222] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:31:51.222] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid: 211348] started [2023-02-21 11:31:51.342] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 11:31:51.342] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export start [2023-02-21 11:31:51.342] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:51.342] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 11:31:51.395] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 11:31:51.395] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Connect to observer [2023-02-21 11:31:51.396] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 11:31:51.788] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 11:31:51.788] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 11:31:51.788] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 11:31:51.789] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:31:51.789] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 11:31:51.791] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 11:31:51.791] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 11:32:01.839] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 4012:Timeout, query has reached the maximum query timeout: 10000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again. [2023-02-21 11:32:01.840] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- execute sql: alter system bootstrap REGION "sys_region" ZONE "zone1" SERVER "10.253.208.65:2882",REGION "sys_region" ZONE "zone2" SERVER "10.253.208.67:2882",REGION "sys_region" ZONE "zone3" SERVER "10.253.208.172:2882" [2023-02-21 11:32:58.195] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- create user "proxyro" IDENTIFIED BY %s [2023-02-21 11:32:58.270] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- grant select on oceanbase.* to proxyro IDENTIFIED BY %s [2023-02-21 11:32:58.329] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 11:32:58.329] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 11:32:58.406] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:32:58.406] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import start [2023-02-21 11:32:58.409] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 11:32:58.411] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Start obproxy [2023-02-21 11:32:58.412] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/obproxy/etc/obproxy_config.bin [2023-02-21 11:32:58.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 11:32:58.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/data/obdata/obproxy/etc/obproxy_config.bin: 没有那个文件或目录 [2023-02-21 11:32:58.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:32:58.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 11:32:58.436] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:32:58.497] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:32:58.497] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 11:32:58.497] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:32:58.498] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- starting 10.253.208.63 obproxy [2023-02-21 11:32:58.498] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/obproxy/lib:' [2023-02-21 11:32:58.499] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/obproxy; /data/obdata/obproxy/bin/obproxy -o obproxy_sys_password='',enable_strict_kernel_release=False,enable_cluster_checkout=False,skip_proxy_sys_private_check=True --listen_port 2883 --prometheus_listen_port 2884 --rs_list '10.253.208.65:2881;10.253.208.67:2881;10.253.208.172:2881' --cluster_name 'obcluster' [2023-02-21 11:32:58.696] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:32:58.696] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 delete env LD_LIBRARY_PATH [2023-02-21 11:32:58.696] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/obproxy/bin/obproxy -o obproxy_sys_password=,enable_strict_kernel_release=False,enable_cluster_checkout=False,skip_proxy_sys_private_check=True --listen_port 2883 --prometheus_listen_port 2884 --rs_list 10.253.208.65:2881;10.253.208.67:2881;10.253.208.172:2881 --cluster_name obcluster$' | grep -v grep | awk '{print $2}' > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:32:58.809] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:32:58.934] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] obproxy program health check [2023-02-21 11:32:58.937] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:32:58.937] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:32:58.964] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:32:58.965] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:32:59.031] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:32:59.031] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 19 [2023-02-21 11:33:00.032] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:00.033] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:33:00.059] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:00.059] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:00.124] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:00.124] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 18 [2023-02-21 11:33:01.125] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:01.126] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:33:01.152] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:01.153] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:01.219] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:01.219] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 2104409873 [2023-02-21 11:33:01.219] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:01.219] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/246751/fd/ |grep -E 'socket:\[(2104409873)\]' [2023-02-21 11:33:01.285] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:01.286] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 11:33:01.349] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:01.349] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 11:33:01.349] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:01.349] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: echo 246751 > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:33:01.409] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:01.493] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 11:33:01.493] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/obproxy && rm -fr /data/obdata/obproxy/obproxyd.sh [2023-02-21 11:33:01.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:01.516] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /data/obdata/obproxy/obproxyd.sh [2023-02-21 11:33:01.559] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/obproxy/obproxyd.sh [2023-02-21 11:33:01.580] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:01.580] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash /data/obdata/obproxy/obproxyd.sh /data/obdata/obproxy 10.253.208.63 2883 [2023-02-21 11:33:01.645] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:02.646] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:02.647] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:33:02.670] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:02.670] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:02.736] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:02.736] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 16 [2023-02-21 11:33:03.737] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:03.738] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:33:03.761] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:03.761] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:03.825] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:03.825] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 obproxy, remaining retries: 15 [2023-02-21 11:33:04.826] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:04.827] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:33:04.850] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:04.850] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:04.911] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:04.912] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 2104410227 [2023-02-21 11:33:04.912] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:04.912] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/246996/fd/ |grep -E 'socket:\[(2104410227)\]' [2023-02-21 11:33:04.973] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:04.974] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 11:33:05.038] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:05.038] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid: 246996] started [2023-02-21 11:33:05.066] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 11:33:05.067] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export start [2023-02-21 11:33:05.067] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:33:05.067] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 11:33:05.068] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 11:33:05.069] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Connect to obproxy [2023-02-21 11:33:05.069] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- connect 10.253.208.63 -P2883 -uroot@proxysys -p [2023-02-21 11:33:05.200] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 11:33:05.200] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 11:33:05.201] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 11:33:05.201] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:33:05.201] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 11:33:05.202] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 11:33:05.202] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set observer_sys_password = [2023-02-21 11:33:05.224] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set obproxy_sys_password = [2023-02-21 11:33:05.244] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 11:33:05.244] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 11:33:05.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:33:05.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import start [2023-02-21 11:33:05.424] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 11:33:05.425] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Start obagent [2023-02-21 11:33:05.473] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:33:05.499] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:05.499] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 11:33:05.499] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:05.500] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:05.582] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 11:33:05.583] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:05.603] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:05.604] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmprklqc9au.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:05.649] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:05.670] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:05.673] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:05.673] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:05.731] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:05.732] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpggb2rsas.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:05.778] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:05.803] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:05.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:05.808] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:05.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:05.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp3fory13z.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:05.914] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:05.936] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:05.939] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 11:33:05.939] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:33:05.998] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:05.998] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp55nu159r.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:33:06.042] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:33:06.063] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:06.065] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:06.066] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:06.127] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:06.127] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmph4nv7f0w.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:06.172] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:06.194] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:06.197] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:06.198] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:06.259] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:06.259] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpiub7505v.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:06.305] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:06.328] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:06.331] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:06.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:06.392] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:06.392] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp49to4vun.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:06.440] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:06.464] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:06.469] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:06.470] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:06.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:06.529] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp9e77tz40.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:06.574] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:06.599] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:06.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:06.602] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:06.664] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:06.665] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp7b5x5xoy.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:06.710] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:06.733] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:06.740] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:33:06.800] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:06.800] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmprugko5cy.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:33:06.846] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:33:06.870] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:06.873] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:33:06.933] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:06.933] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:33:06.962] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:06.963] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 11:33:06.963] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:06.963] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:07.048] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 11:33:07.049] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:07.072] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:07.073] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp_mkvzy7n.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:07.121] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:07.140] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:07.144] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:07.144] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:07.202] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:07.203] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp9sdca2gg.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:07.252] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:07.273] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:07.277] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:07.277] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:07.335] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:07.336] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpn16kr7tl.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:07.384] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:07.403] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:07.405] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 11:33:07.406] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:33:07.464] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:07.464] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp3sth8ns3.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:33:07.510] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:33:07.533] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:07.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:07.536] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:07.595] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:07.596] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpy6hdsaca.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:07.645] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:07.671] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:07.674] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:07.675] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:07.735] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:07.735] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpthwno9rs.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:07.782] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:07.802] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:07.806] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:07.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:07.864] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:07.864] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpqq6eb2oh.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:07.919] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:07.942] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:07.947] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:07.947] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:08.006] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:08.006] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp5pwdm4jb.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:08.054] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:08.079] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:08.082] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:08.083] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:08.142] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:08.142] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmphdje6z5h.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:08.190] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:08.211] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:08.218] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:33:08.278] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:08.278] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpejeb5a85.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:33:08.327] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:33:08.367] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:08.371] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:33:08.433] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:08.433] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:33:08.462] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:08.462] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 11:33:08.462] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:08.463] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:08.557] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 11:33:08.557] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:08.585] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:08.585] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp4tezyoo5.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:08.630] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 11:33:08.656] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:08.659] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:08.659] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:08.725] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:08.725] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpbgp25bn5.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:08.771] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 11:33:08.795] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:08.800] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:08.800] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:08.869] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:08.870] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpkhnaf46r.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:08.915] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 11:33:08.941] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:08.944] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 11:33:08.944] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:33:09.014] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:09.014] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmp4tf5v2pr.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:33:09.059] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 11:33:09.107] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:09.110] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:09.110] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:09.176] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:09.177] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpt7puiy5b.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:09.222] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 11:33:09.250] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:09.252] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:09.253] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:09.319] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:09.319] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpbpkw5ray.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:09.366] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 11:33:09.394] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:09.397] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:09.398] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:09.459] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:09.460] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpp6z5oaw3.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:09.508] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 11:33:09.535] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:09.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:09.542] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:09.600] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:09.601] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpix219sub.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:09.646] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 11:33:09.690] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:09.693] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:09.693] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:09.785] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:09.785] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmptiwydfil.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:09.830] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 11:33:09.861] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:09.868] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:33:09.934] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:09.935] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpzjrud8bz.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:33:09.980] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 11:33:10.013] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:10.016] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:33:10.081] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:10.119] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] obagent program health check [2023-02-21 11:33:11.121] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 11:33:11.121] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:33:11.146] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:11.147] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:11.215] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:11.215] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 11:33:11.215] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:33:11.238] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:11.238] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:11.303] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:11.303] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 11:33:11.303] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:33:11.328] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:11.329] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:11.408] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:11.409] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- start to sync target config [2023-02-21 11:33:11.424] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 11:33:11.424] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export start [2023-02-21 11:33:11.424] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obagent-py_script_connect-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:33:11.424] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 11:33:11.425] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 11:33:11.425] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 11:33:11.425] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 11:33:11.425] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:33:11.425] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import start [2023-02-21 11:33:11.428] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 11:33:11.429] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Start promethues [2023-02-21 11:33:11.430] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/.prometheus_started [2023-02-21 11:33:11.453] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 11:33:11.453] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/data/obdata/prometheus/.prometheus_started: 没有那个文件或目录 [2023-02-21 11:33:11.453] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:11.454] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:33:11.514] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 11:33:11.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/data/obdata/prometheus/prometheus.yaml: 没有那个文件或目录 [2023-02-21 11:33:11.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:11.515] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- load config from obagent [2023-02-21 11:33:11.516] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- open /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml for r [2023-02-21 11:33:11.516] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus/rules [2023-02-21 11:33:11.576] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:11.608] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus/rules && rm -fr /data/obdata/prometheus/rules/host_rules.yaml [2023-02-21 11:33:11.638] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:11.639] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/rules/host_rules.yaml to /data/obdata/prometheus/rules/host_rules.yaml [2023-02-21 11:33:11.685] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 755 /data/obdata/prometheus/rules/host_rules.yaml [2023-02-21 11:33:11.707] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:11.707] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus/rules && rm -fr /data/obdata/prometheus/rules/ob_rules.yaml [2023-02-21 11:33:11.770] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:11.770] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/rules/ob_rules.yaml to /data/obdata/prometheus/rules/ob_rules.yaml [2023-02-21 11:33:11.816] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 755 /data/obdata/prometheus/rules/ob_rules.yaml [2023-02-21 11:33:11.837] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- write global: [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] scrape_interval: 1s [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] evaluation_interval: 10s [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] rule_files: [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - rules/*rules.yaml [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] scrape_configs: [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - job_name: prometheus [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] metrics_path: /metrics [2023-02-21 11:33:11.982] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.63:9090 [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - job_name: node [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] password: root [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] metrics_path: /metrics/node/host [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - files: [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - job_name: ob_basic [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] password: root [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/basic [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 11:33:11.983] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - files: [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - job_name: ob_extra [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] password: root [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/extra [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - files: [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - job_name: agent [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] password: root [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] metrics_path: /metrics/stat [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 11:33:11.984] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 11:33:11.985] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 11:33:11.985] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 11:33:11.985] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 11:33:11.985] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 11:33:11.985] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - files: [2023-02-21 11:33:11.985] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - targets/*.yaml to admin@10.253.208.63:22: /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:33:11.986] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:33:12.011] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:12.011] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpxai7so8_ to /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:33:12.058] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/prometheus/prometheus.yaml [2023-02-21 11:33:12.083] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:12.086] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 11:33:12.146] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:12.146] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 11:33:12.191] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 11:33:12.212] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:12.212] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle --start-only [2023-02-21 11:33:12.328] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:12.329] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheus.pid` && ls /proc/$pid [2023-02-21 11:33:12.396] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:13.399] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] prometheus program health check [2023-02-21 11:33:13.400] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:13.400] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:33:13.423] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:13.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 11:33:13.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export start [2023-02-21 11:33:13.531] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:33:13.531] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 11:33:13.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 11:33:13.533] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Connect to Prometheus [2023-02-21 11:33:13.533] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- connect prometheus (10.253.208.63:9090 by user None) [2023-02-21 11:33:13.534] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 11:33:13.665] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 11:33:13.665] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 11:33:13.666] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 11:33:13.666] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:33:13.666] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 11:33:13.667] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 11:33:13.667] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: touch /data/obdata/prometheus/.prometheus_started [2023-02-21 11:33:13.689] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:13.689] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 11:33:13.689] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 11:33:13.797] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:33:13.797] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import start [2023-02-21 11:33:13.801] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 11:33:13.802] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Start grafana [2023-02-21 11:33:13.802] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate obd-grafana ini file [2023-02-21 11:33:13.804] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf && rm -fr /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 11:33:13.827] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:13.828] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpiwvobp_z.ini to /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 11:33:13.872] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 11:33:13.894] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:13.895] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate datasources yaml [2023-02-21 11:33:13.897] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 11:33:13.897] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] datasources: [2023-02-21 11:33:13.897] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: OB-Prometheus [2023-02-21 11:33:13.897] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] isDefault: 'true' [2023-02-21 11:33:13.897] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] type: prometheus [2023-02-21 11:33:13.898] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] access: proxy [2023-02-21 11:33:13.898] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] editable: 'true' [2023-02-21 11:33:13.898] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] url: http://10.253.208.63:9090 to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 11:33:13.898] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/datasources && rm -fr /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 11:33:13.955] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:13.955] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmprne4mhas to /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 11:33:13.999] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 11:33:14.022] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:14.024] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate providers yaml [2023-02-21 11:33:14.026] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 11:33:14.026] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] providers: [2023-02-21 11:33:14.026] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - name: OceanBase Metrics [2023-02-21 11:33:14.026] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] type: file [2023-02-21 11:33:14.026] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] allowUiUpdates: 'true' [2023-02-21 11:33:14.026] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] options: [2023-02-21 11:33:14.026] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] path: /data/obdata/grafana/conf/provisioning/dashboards/templates to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 11:33:14.027] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 11:33:14.087] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:14.087] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send /tmp/tmpjztoxk7t to /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 11:33:14.132] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 11:33:14.155] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 11:33:14.157] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 11:33:14.237] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:14.238] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/grafana; bash -c '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid > /data/obdata/grafana/data/log/grafana-console.log 2>&1 &' [2023-02-21 11:33:14.299] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:14.300] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 11:33:14.381] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:15.457] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] grafana program health check [2023-02-21 11:33:15.458] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:15.458] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:15.458] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:15.487] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:15.487] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 19 [2023-02-21 11:33:16.490] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:16.490] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:16.490] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:16.530] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:16.531] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 18 [2023-02-21 11:33:17.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:17.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:17.532] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:17.558] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:17.558] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:17.620] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:17.620] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:17.620] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:17.621] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 17 [2023-02-21 11:33:18.621] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:18.622] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:18.622] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:18.648] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:18.648] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:18.710] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:18.711] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:18.711] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:18.711] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 16 [2023-02-21 11:33:19.712] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:19.712] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:19.712] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:19.740] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:19.741] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:19.805] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:19.806] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:19.806] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:19.806] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 15 [2023-02-21 11:33:20.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:20.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:20.807] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:20.835] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:20.836] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:20.897] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:20.898] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:20.898] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:20.898] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 14 [2023-02-21 11:33:21.899] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:21.899] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:21.900] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:21.929] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:21.930] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:21.992] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:21.993] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:21.993] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:21.993] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 13 [2023-02-21 11:33:22.994] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:22.994] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:22.994] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:23.022] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:23.022] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:23.084] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:23.085] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:23.085] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:23.085] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 12 [2023-02-21 11:33:24.086] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:24.086] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:24.087] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:24.113] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:24.114] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:24.176] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:24.176] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:24.176] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:24.177] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 11 [2023-02-21 11:33:25.178] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:25.178] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:25.178] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:25.208] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:25.209] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:25.272] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:25.272] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:25.272] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:25.272] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 10 [2023-02-21 11:33:26.273] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:26.273] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:26.273] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:26.301] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:26.301] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:26.364] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:26.364] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:26.364] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:26.364] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 9 [2023-02-21 11:33:27.365] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:27.366] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:27.366] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:27.392] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:27.393] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:27.456] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:27.457] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:27.457] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:27.457] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 8 [2023-02-21 11:33:28.458] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:28.458] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:28.459] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:28.486] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:28.486] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:28.549] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:28.549] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:28.549] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:28.549] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 7 [2023-02-21 11:33:29.550] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:29.550] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:29.551] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:29.576] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:29.577] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:29.638] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:29.639] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:29.639] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:29.639] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 6 [2023-02-21 11:33:30.640] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:30.640] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:30.641] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:30.666] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:30.666] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:30.727] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:30.727] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:30.727] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:30.728] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 5 [2023-02-21 11:33:31.729] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:31.729] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:31.729] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:31.756] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:31.756] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:31.817] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:31.818] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:31.818] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:31.818] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 4 [2023-02-21 11:33:32.819] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:32.819] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:32.819] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:32.848] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:32.848] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:32.909] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:32.909] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:32.910] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:32.910] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 3 [2023-02-21 11:33:33.911] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:33.911] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:33.911] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:33.940] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:33.940] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:34.004] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:34.005] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:34.005] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:34.005] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 2 [2023-02-21 11:33:35.006] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:35.007] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:35.007] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:35.033] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:35.033] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:35.094] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:35.094] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:35.095] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:35.095] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 1 [2023-02-21 11:33:36.096] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 11:33:36.096] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fe8835eef60>: ['']} [2023-02-21 11:33:36.097] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 11:33:36.122] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:36.123] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104410645)\]' [2023-02-21 11:33:36.183] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 11:33:36.183] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 11:33:36.184] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] [2023-02-21 11:33:36.184] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 0 [2023-02-21 11:33:36.184] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [WARNING] [WARN] failed to start 10.253.208.63 grafana [2023-02-21 11:33:36.184] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 11:33:36.184] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export start [2023-02-21 11:33:36.185] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [ERROR] [ERROR] grafana start failed [2023-02-21 11:33:36.185] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:33:36.185] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import display [2023-02-21 11:33:36.186] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 11:33:36.186] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] Wait for observer init [2023-02-21 11:33:36.191] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 11:33:36.191] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | observer | [2023-02-21 11:33:36.191] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:33:36.191] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 11:33:36.192] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:33:36.192] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 11:33:36.192] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 11:33:36.192] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 11:33:36.192] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:33:36.192] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | observer | [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export display [2023-02-21 11:33:36.318] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:33:36.319] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import display [2023-02-21 11:33:36.319] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +-------------------------------------------------+ [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | obproxy | [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | ip | port | prometheus_port | status | [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | 10.253.208.63 | 2883 | 2884 | active | [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] obclient -h10.253.208.63 -P2883 -uroot -Doceanbase -A [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export display [2023-02-21 11:33:36.330] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call obagent-py_script_display-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:33:36.331] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import display [2023-02-21 11:33:36.331] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 11:33:36.332] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.65:8088/metrics/stat" [2023-02-21 11:33:36.371] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:36.372] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.67:8088/metrics/stat" [2023-02-21 11:33:36.411] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:36.411] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.172:8088/metrics/stat" [2023-02-21 11:33:36.465] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +----------------------------------------------------+ [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | obagent | [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | ip | server_port | pprof_port | status | [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | 10.253.208.65 | 8088 | 8089 | active | [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | 10.253.208.67 | 8088 | 8089 | active | [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | 10.253.208.172 | 8088 | 8089 | active | [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 11:33:36.468] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export display [2023-02-21 11:33:36.469] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:33:36.469] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - import display [2023-02-21 11:33:36.470] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 11:33:36.470] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 11:33:36.474] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +------------------------------------------------------+ [2023-02-21 11:33:36.474] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | prometheus | [2023-02-21 11:33:36.474] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 11:33:36.474] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 11:33:36.474] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 11:33:36.474] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] | http://10.253.208.63:9090 | | | active | [2023-02-21 11:33:36.474] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 11:33:36.474] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 11:33:36.474] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - export display [2023-02-21 11:33:36.475] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 11:33:36.475] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 3 [2023-02-21 11:33:36.475] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 27 [2023-02-21 11:33:36.475] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 32 [2023-02-21 11:33:36.475] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 31 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 30 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 26 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 25 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 24 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 23 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 22 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 21 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 20 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 29 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 28 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 27 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 19 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 26 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 25 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 24 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 18 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 23 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 22 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 21 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 17 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 20 [2023-02-21 11:33:36.476] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 19 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 18 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 16 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 17 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 16 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 15 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 15 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 2 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 14 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 13 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 12 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 11 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 10 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 14 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 13 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 12 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 9 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 8 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 11 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 10 [2023-02-21 11:33:36.477] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 9 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 7 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 6 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 8 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 7 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 6 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 5 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 5 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 11:33:36.478] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:33:36.479] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 1 [2023-02-21 11:33:36.479] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:33:36.479] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:33:36.479] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:33:36.479] [29e4af18-b198-11ed-bc91-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:48:35.745] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:48:35.746] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:48:35.746] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:48:35.746] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:48:35.746] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'with_parameter': None} [2023-02-21 11:48:35.747] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:48:35.747] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:48:35.747] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:48:35.747] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:48:35.747] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:48:35.759] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [INFO] Get local repositories and plugins [2023-02-21 11:48:35.806] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 11:48:35.806] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:35.807] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:48:35.807] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 11:48:35.809] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:35.810] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 11:48:35.812] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:35.812] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 11:48:35.815] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:35.815] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 11:48:35.818] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:35.818] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 11:48:35.820] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching restart plugin for components ... [2023-02-21 11:48:35.821] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching restart plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:35.821] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 11:48:35.822] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_restart-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:48:35.822] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching restart plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:35.822] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_restart-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:48:35.822] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching restart plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:35.823] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_restart-0.1 for obagent-1.2.0 [2023-02-21 11:48:35.823] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching restart plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:35.823] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_restart-2.37.1 for prometheus-2.37.1 [2023-02-21 11:48:35.823] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching restart plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:35.823] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_restart-7.5.17 for grafana-7.5.17 [2023-02-21 11:48:35.823] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching reload plugin for components ... [2023-02-21 11:48:35.823] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching reload plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:35.824] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_reload-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:48:35.824] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching reload plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:35.824] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_reload-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:48:35.824] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching reload plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:35.824] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_reload-0.1 for obagent-1.2.0 [2023-02-21 11:48:35.824] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching reload plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:35.824] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_reload-2.37.1 for prometheus-2.37.1 [2023-02-21 11:48:35.824] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching reload plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:35.825] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_reload-7.5.17 for grafana-7.5.17 [2023-02-21 11:48:35.825] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 11:48:35.825] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:35.825] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:48:35.825] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:35.826] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:48:35.826] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:35.826] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 11:48:35.826] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:35.826] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 11:48:35.826] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:35.826] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 11:48:35.826] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching stop plugin for components ... [2023-02-21 11:48:35.826] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:35.827] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:48:35.827] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:35.827] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:48:35.827] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching stop plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:35.827] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_stop-0.1 for obagent-1.2.0 [2023-02-21 11:48:35.828] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching stop plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:35.828] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_stop-2.37.1 for prometheus-2.37.1 [2023-02-21 11:48:35.828] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching stop plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:35.828] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_stop-7.5.17 for grafana-7.5.17 [2023-02-21 11:48:35.828] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 11:48:35.828] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:35.828] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:48:35.829] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:35.829] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:48:35.829] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:35.829] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 11:48:35.829] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:35.829] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 11:48:35.829] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:35.829] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 11:48:35.830] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 11:48:35.830] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:35.830] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:48:35.830] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:35.830] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:48:35.830] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:35.831] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 11:48:35.831] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:35.831] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 11:48:35.831] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:35.831] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 11:48:35.831] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 11:48:35.831] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:35.832] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:48:35.832] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:35.832] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:48:35.832] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:35.832] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 11:48:35.832] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:35.833] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 11:48:35.833] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:35.833] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 11:48:35.891] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 11:48:35.891] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 11:48:35.891] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 11:48:35.892] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:48:35.892] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:36.592] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 11:48:36.592] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:48:36.593] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:36.772] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 11:48:36.772] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 11:48:36.772] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:36.879] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 11:48:36.879] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 11:48:36.879] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:36.903] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 11:48:36.903] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 11:48:36.903] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:37.067] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 11:48:38.111] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [INFO] Cluster status check [2023-02-21 11:48:38.112] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching status plugin for components ... [2023-02-21 11:48:38.112] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching status plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:38.113] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 11:48:38.113] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching status plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:38.113] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 11:48:38.113] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching status plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:38.113] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_status-0.1 for obagent-1.2.0 [2023-02-21 11:48:38.113] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching status plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:38.114] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_status-2.37.1 for prometheus-2.37.1 [2023-02-21 11:48:38.114] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Searching status plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:38.114] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_status-7.5.17 for grafana-7.5.17 [2023-02-21 11:48:38.114] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:48:38.114] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:48:38.115] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:48:38.116] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:48:38.267] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.267] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/118859 [2023-02-21 11:48:38.329] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.329] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:48:38.360] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.360] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/25791 [2023-02-21 11:48:38.423] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.423] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 11:48:38.451] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.452] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/211348 [2023-02-21 11:48:38.521] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.521] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:48:38.521] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:48:38.521] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:48:38.522] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:48:38.522] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:48:38.523] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 11:48:38.547] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.548] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/246996 [2023-02-21 11:48:38.607] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.608] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:48:38.608] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:48:38.608] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Call obagent-py_script_status-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:48:38.608] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:48:38.609] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:48:38.609] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 11:48:38.634] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.634] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/119875 [2023-02-21 11:48:38.696] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.696] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 11:48:38.717] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.717] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/26733 [2023-02-21 11:48:38.793] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.794] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 11:48:38.886] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.886] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/212299 [2023-02-21 11:48:38.971] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.972] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:48:38.972] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:48:38.972] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_status-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:48:38.972] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:48:38.973] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:48:38.973] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 11:48:38.995] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:38.996] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:48:38.996] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:48:38.996] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Call grafana-py_script_status-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:48:38.996] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - import status [2023-02-21 11:48:38.997] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 11:48:38.997] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 11:48:39.057] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:39.057] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/247480 [2023-02-21 11:48:39.118] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 11:48:39.119] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 11:48:39.119] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - export status [2023-02-21 11:48:39.119] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - Deploy status inconsistent [2023-02-21 11:48:39.155] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [ERROR] [ERROR] OBD-1005: Some of the servers in the cluster have been stopped [2023-02-21 11:48:39.155] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [INFO] 10.253.208.63 prometheus is stopped [2023-02-21 11:48:39.155] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 11:48:39.156] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 11:48:39.156] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 11:48:39.156] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 11:48:39.156] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 11:48:39.156] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 11:48:39.156] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:48:39.156] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:48:39.156] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:48:39.156] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:48:39.156] [9e4f9cee-b19a-11ed-8a82-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 11:49:29.663] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 11:49:29.664] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 11:49:29.664] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 11:49:29.664] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 11:49:29.664] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - opts: {} [2023-02-21 11:49:29.664] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 11:49:29.664] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 11:49:29.665] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 11:49:29.665] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:49:29.665] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 11:49:29.722] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - allow include file not exists [2023-02-21 11:49:29.722] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Load /home/admin/.obd/cluster/observer/config.yaml [2023-02-21 11:49:29.722] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 11:49:29.722] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:49:29.723] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:49:29.723] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 11:49:29.725] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:49:29.725] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 11:49:29.728] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:49:29.728] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 11:49:29.730] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:49:29.731] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 11:49:29.733] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:49:29.733] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 11:49:29.736] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [INFO] Search param plugin and load [2023-02-21 11:49:29.736] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:49:29.737] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 11:49:29.737] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 11:49:30.429] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:49:30.429] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 11:49:30.597] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Search param plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:49:30.598] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 11:49:30.698] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:49:30.698] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 11:49:30.721] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Search param plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:49:30.722] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 11:49:30.777] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Get environment variable EDITOR=vi [2023-02-21 11:49:30.777] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Create tmp yaml file [2023-02-21 11:49:30.781] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - vi /tmp/tmpn49opadh.yaml [2023-02-21 11:49:34.518] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Load /tmp/tmpn49opadh.yaml [2023-02-21 11:49:34.563] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Configure component change check [2023-02-21 11:49:34.563] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - Information check for the configuration component. [2023-02-21 11:49:34.564] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [INFO] Search param plugin and load [2023-02-21 11:49:34.696] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [INFO] Parameter check [2023-02-21 11:49:34.696] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - server1(10.253.208.65) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:49:34.697] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - server2(10.253.208.67) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:49:34.697] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - server3(10.253.208.172) oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d param check [2023-02-21 11:49:34.697] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - 10.253.208.63 obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 param check [2023-02-21 11:49:34.698] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - server1(10.253.208.65) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:49:34.698] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - server2(10.253.208.67) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:49:34.698] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - server3(10.253.208.172) obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e param check [2023-02-21 11:49:34.698] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - 10.253.208.63 prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 param check [2023-02-21 11:49:34.698] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - 10.253.208.63 grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 param check [2023-02-21 11:49:34.828] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - configure change check [2023-02-21 11:49:34.829] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [INFO] Deploy "observer" config unchange [2023-02-21 11:49:34.831] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 11:49:34.831] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 11:49:34.832] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 11:49:34.832] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 11:49:34.832] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 11:49:34.832] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 11:49:34.832] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 11:49:34.832] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 11:49:34.832] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 11:49:34.832] [be72c820-b19a-11ed-aa91-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 14:59:09.011] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 14:59:09.011] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 14:59:09.011] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 14:59:09.011] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 14:59:09.012] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2023-02-21 14:59:09.012] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 14:59:09.012] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 14:59:09.012] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 14:59:09.012] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 14:59:09.012] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 14:59:09.025] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 14:59:09.025] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 14:59:09.026] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 14:59:09.026] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:09.026] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: 4.0.0.0, tag: 1d56dc742f5f05a2d15797d291b51a94019e728d, release: None, package_hash: None [2023-02-21 14:59:09.027] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 14:59:09.027] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 14:59:09.027] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2023-02-21 14:59:09.031] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:09.031] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:09.031] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: de53232a951184fad75b15884458d85e31d2f6c3, release: None, package_hash: None [2023-02-21 14:59:09.032] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 14:59:09.032] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2023-02-21 14:59:09.036] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:09.036] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:09.036] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Search repository obagent version: 1.2.0, tag: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e, release: None, package_hash: None [2023-02-21 14:59:09.036] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 14:59:09.036] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obagent [2023-02-21 14:59:09.041] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:09.041] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:09.041] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Search repository prometheus version: 2.37.1, tag: 58913c7606f05feb01bc1c6410346e5fc31cf263, release: None, package_hash: None [2023-02-21 14:59:09.041] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 14:59:09.041] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/prometheus [2023-02-21 14:59:09.045] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:09.045] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 14:59:09.045] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Search repository grafana version: 7.5.17, tag: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, release: None, package_hash: None [2023-02-21 14:59:09.045] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 14:59:09.045] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/grafana [2023-02-21 14:59:09.049] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 14:59:09.158] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 14:59:09.208] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Search plugins [2023-02-21 14:59:09.209] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start_check plugin for components ... [2023-02-21 14:59:09.210] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:09.210] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 14:59:09.211] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 14:59:09.211] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:09.211] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 14:59:09.211] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:09.212] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start_check-1.1.1 for obagent-1.2.0 [2023-02-21 14:59:09.212] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start_check plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:09.212] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1 [2023-02-21 14:59:09.212] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start_check plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 14:59:09.212] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start_check-7.5.17 for grafana-7.5.17 [2023-02-21 14:59:09.212] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 14:59:09.212] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:09.213] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 14:59:09.213] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:09.213] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 14:59:09.213] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:09.214] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 14:59:09.214] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:09.214] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 14:59:09.214] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 14:59:09.214] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 14:59:09.214] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 14:59:09.214] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:09.215] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 14:59:09.215] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:09.215] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 14:59:09.215] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:09.215] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 14:59:09.215] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:09.216] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 14:59:09.216] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 14:59:09.216] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 14:59:09.216] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 14:59:09.216] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:09.217] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 14:59:09.217] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:09.217] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 14:59:09.217] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:09.217] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 14:59:09.217] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:09.217] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 14:59:09.218] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 14:59:09.218] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 14:59:09.218] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 14:59:09.218] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:09.218] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 14:59:09.218] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:09.219] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 14:59:09.219] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:09.219] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 14:59:09.219] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:09.219] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 14:59:09.219] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 14:59:09.219] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 14:59:09.340] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 14:59:10.385] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 14:59:10.388] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 14:59:10.388] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 14:59:10.389] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 14:59:10.389] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:11.076] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 14:59:11.076] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 14:59:11.077] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:11.246] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 14:59:11.247] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 14:59:11.247] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:11.351] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 14:59:11.352] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 14:59:11.352] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:11.379] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 14:59:11.379] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 14:59:11.379] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 14:59:11.424] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:11.424] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 14:59:11.433] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 14:59:11.434] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Check before start observer [2023-02-21 14:59:11.435] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 14:59:11.478] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:11.478] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/118859 [2023-02-21 14:59:11.542] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:11.543] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 14:59:11.578] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:11.578] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/25791 [2023-02-21 14:59:11.648] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:11.649] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 14:59:11.789] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:11.790] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/211348 [2023-02-21 14:59:11.881] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:11.882] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: date +%s%N [2023-02-21 14:59:11.906] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:11.907] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.65 time delta -1.66650390625 [2023-02-21 14:59:11.907] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: date +%s%N [2023-02-21 14:59:11.988] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:11.988] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.67 time delta -1.918701171875 [2023-02-21 14:59:11.988] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: date +%s%N [2023-02-21 14:59:12.026] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.027] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.172 time delta -2.1650390625 [2023-02-21 14:59:12.087] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 14:59:12.087] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 14:59:12.087] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:12.087] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 14:59:12.092] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 14:59:12.092] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Check before start obproxy [2023-02-21 14:59:12.093] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 14:59:12.120] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.121] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/246996/fd [2023-02-21 14:59:12.181] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.224] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 14:59:12.224] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 14:59:12.224] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start_check-1.1.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:12.224] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 14:59:12.228] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 14:59:12.229] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Check before start obagent [2023-02-21 14:59:12.230] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 14:59:12.254] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.254] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/119875 [2023-02-21 14:59:12.317] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.318] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 14:59:12.345] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.345] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/26733 [2023-02-21 14:59:12.409] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.410] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 14:59:12.447] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.448] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/212299 [2023-02-21 14:59:12.514] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.621] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 14:59:12.621] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 14:59:12.622] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:12.622] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 14:59:12.628] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 14:59:12.629] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Check before start prometheus [2023-02-21 14:59:12.630] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 14:59:12.655] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.656] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 14:59:12.656] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:12.729] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.761] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 14:59:12.761] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 14:59:12.761] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start_check-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 14:59:12.761] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 14:59:12.766] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 14:59:12.766] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Check before start grafana [2023-02-21 14:59:12.767] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 14:59:12.790] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.790] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/247480 [2023-02-21 14:59:12.851] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.898] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 14:59:12.898] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 14:59:12.898] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:12.898] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import start [2023-02-21 14:59:12.905] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 14:59:12.905] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Start observer [2023-02-21 14:59:12.906] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 14:59:12.937] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:12.938] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/118859 [2023-02-21 14:59:13.003] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:13.003] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 14:59:13.049] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:13.049] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/25791 [2023-02-21 14:59:13.111] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:13.112] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 14:59:13.140] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:13.141] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/211348 [2023-02-21 14:59:13.211] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:13.298] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] observer program health check [2023-02-21 14:59:16.302] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 14:59:16.302] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 14:59:16.330] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:16.330] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/118859 [2023-02-21 14:59:16.395] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:16.395] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid: 118859] started [2023-02-21 14:59:16.395] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 14:59:16.395] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 14:59:16.418] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:16.418] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/25791 [2023-02-21 14:59:16.481] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:16.482] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid: 25791] started [2023-02-21 14:59:16.482] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 14:59:16.482] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 14:59:16.517] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:16.517] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/211348 [2023-02-21 14:59:16.584] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:16.585] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid: 211348] started [2023-02-21 14:59:16.690] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 14:59:16.690] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export start [2023-02-21 14:59:16.691] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:16.691] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 14:59:16.884] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 14:59:16.885] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Connect to observer [2023-02-21 14:59:16.885] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 14:59:17.016] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 14:59:17.016] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 14:59:17.017] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 14:59:17.018] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:17.018] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 14:59:17.030] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 14:59:17.030] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 14:59:17.036] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 14:59:17.036] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 14:59:17.148] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:17.149] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import start [2023-02-21 14:59:17.157] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 14:59:17.160] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Start obproxy [2023-02-21 14:59:17.161] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/obproxy/etc/obproxy_config.bin [2023-02-21 14:59:17.183] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:17.184] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 14:59:17.184] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 14:59:17.246] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:17.246] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/246996/ [2023-02-21 14:59:17.309] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:17.310] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:17.373] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:17.373] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 2104410227 [2023-02-21 14:59:17.373] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:17.373] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/246996/fd/ |grep -E 'socket:\[(2104410227)\]' [2023-02-21 14:59:17.438] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:17.553] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] obproxy program health check [2023-02-21 14:59:17.553] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:17.554] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 14:59:17.574] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:17.575] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:17.637] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:17.638] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 2104410227 [2023-02-21 14:59:17.638] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:17.638] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/246996/fd/ |grep -E 'socket:\[(2104410227)\]' [2023-02-21 14:59:17.702] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:17.703] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 14:59:17.767] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:17.767] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid: 246996] started [2023-02-21 14:59:17.814] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 14:59:17.814] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export start [2023-02-21 14:59:17.815] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:17.815] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 14:59:17.822] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 14:59:17.823] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Connect to obproxy [2023-02-21 14:59:17.824] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- connect 10.253.208.63 -P2883 -uroot@proxysys -p [2023-02-21 14:59:17.955] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 14:59:17.955] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 14:59:17.955] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 14:59:17.956] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:17.956] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 14:59:17.969] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 14:59:17.969] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set observer_sys_password = [2023-02-21 14:59:17.991] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set obproxy_sys_password = [2023-02-21 14:59:18.015] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 14:59:18.015] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 14:59:18.087] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:18.087] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import start [2023-02-21 14:59:18.656] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 14:59:18.657] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Start obagent [2023-02-21 14:59:18.727] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 14:59:18.755] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:18.756] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/119875 [2023-02-21 14:59:18.820] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:18.820] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 14:59:18.863] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:18.864] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/26733 [2023-02-21 14:59:18.961] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:18.962] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 14:59:19.008] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:19.008] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/212299 [2023-02-21 14:59:19.088] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:19.181] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] obagent program health check [2023-02-21 14:59:20.183] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 14:59:20.183] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 14:59:20.206] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:20.207] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:20.279] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:20.279] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 14:59:20.279] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 14:59:20.302] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:20.302] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:20.384] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:20.385] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 14:59:20.385] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 14:59:20.410] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:20.411] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:20.503] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:20.503] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- start to sync target config [2023-02-21 14:59:20.616] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 14:59:20.616] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export start [2023-02-21 14:59:20.616] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call obagent-py_script_connect-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:20.616] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 14:59:20.619] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 14:59:20.620] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 14:59:20.620] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 14:59:20.620] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:20.620] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import start [2023-02-21 14:59:20.627] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 14:59:20.628] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Start promethues [2023-02-21 14:59:20.629] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/.prometheus_started [2023-02-21 14:59:20.651] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:20.652] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/prometheus.yaml [2023-02-21 14:59:20.713] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:20.714] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/prometheus.yaml [2023-02-21 14:59:20.780] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- write global: [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] scrape_interval: 1s [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] evaluation_interval: 10s [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] rule_files: [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - rules/*rules.yaml [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] scrape_configs: [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - job_name: prometheus [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] metrics_path: /metrics [2023-02-21 14:59:20.816] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.63:9090 [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - job_name: node [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] password: root [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] metrics_path: /metrics/node/host [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - files: [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - job_name: ob_basic [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] password: root [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/basic [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 14:59:20.817] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - files: [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - job_name: ob_extra [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] password: root [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/extra [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - files: [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - job_name: agent [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] password: root [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] metrics_path: /metrics/stat [2023-02-21 14:59:20.818] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 14:59:20.819] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 14:59:20.819] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 14:59:20.819] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 14:59:20.819] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 14:59:20.819] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 14:59:20.819] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 14:59:20.819] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - files: [2023-02-21 14:59:20.819] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - targets/*.yaml to admin@10.253.208.63:22: /data/obdata/prometheus/prometheus.yaml [2023-02-21 14:59:20.882] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 14:59:20.883] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheus.yaml [2023-02-21 14:59:20.918] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:20.919] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- send /tmp/tmps96n176_ to /data/obdata/prometheus/prometheus.yaml [2023-02-21 14:59:20.967] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/prometheus/prometheus.yaml [2023-02-21 14:59:20.994] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 14:59:20.998] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 14:59:21.056] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:21.056] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 14:59:21.101] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 14:59:21.121] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 14:59:21.121] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle --start-only [2023-02-21 14:59:21.238] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:21.238] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheus.pid` && ls /proc/$pid [2023-02-21 14:59:21.303] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:22.412] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] prometheus program health check [2023-02-21 14:59:22.413] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:22.413] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 14:59:22.435] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:22.435] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:22.499] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:22.500] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 2104406405 [2023-02-21 14:59:22.500] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:22.500] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/247311/fd/ |grep -E 'socket:\[(2104406405)\]' [2023-02-21 14:59:22.563] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:22.564] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 14:59:22.623] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:22.624] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] cat: /data/obdata/prometheus/run/prometheusd.pid: 没有那个文件或目录 [2023-02-21 14:59:22.624] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:22.624] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 14:59:22.684] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:22.684] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 14:59:22.728] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 14:59:22.748] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 14:59:22.748] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle [2023-02-21 14:59:22.819] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:23.821] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:23.821] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 14:59:23.843] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:23.844] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:23.911] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:23.911] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 prometheus, remaining retries: 18 [2023-02-21 14:59:24.913] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:24.913] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 14:59:24.940] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:24.940] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:25.008] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:25.008] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 2104634173 [2023-02-21 14:59:25.008] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:25.008] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/33759/fd/ |grep -E 'socket:\[(2104634173)\]' [2023-02-21 14:59:25.070] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:25.070] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 14:59:25.147] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:25.147] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheusd[pid: 33759] started [2023-02-21 14:59:25.152] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 14:59:25.152] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export start [2023-02-21 14:59:25.152] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:25.153] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 14:59:25.157] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 14:59:25.158] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Connect to Prometheus [2023-02-21 14:59:25.160] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- connect prometheus (10.253.208.63:9090 by user None) [2023-02-21 14:59:25.160] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 14:59:25.294] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 14:59:25.294] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 14:59:25.297] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 14:59:25.299] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:25.300] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 14:59:25.303] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 14:59:25.303] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: touch /data/obdata/prometheus/.prometheus_started [2023-02-21 14:59:25.336] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:25.336] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 14:59:25.336] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 14:59:25.429] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 14:59:25.429] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import start [2023-02-21 14:59:25.439] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 14:59:25.439] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Start grafana [2023-02-21 14:59:25.440] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate obd-grafana ini file [2023-02-21 14:59:25.441] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf && rm -fr /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 14:59:25.475] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:25.475] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- send /tmp/tmpq56mevlb.ini to /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 14:59:25.519] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 14:59:25.543] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 14:59:25.546] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate datasources yaml [2023-02-21 14:59:25.548] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 14:59:25.548] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] datasources: [2023-02-21 14:59:25.548] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - name: OB-Prometheus [2023-02-21 14:59:25.548] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] isDefault: 'true' [2023-02-21 14:59:25.548] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] type: prometheus [2023-02-21 14:59:25.548] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] access: proxy [2023-02-21 14:59:25.548] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] editable: 'true' [2023-02-21 14:59:25.548] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] url: http://10.253.208.63:9090 to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 14:59:25.549] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/datasources && rm -fr /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 14:59:25.605] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:25.606] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- send /tmp/tmpkf0o99r0 to /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 14:59:25.652] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 14:59:25.674] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 14:59:25.677] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate providers yaml [2023-02-21 14:59:25.679] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 14:59:25.679] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] providers: [2023-02-21 14:59:25.679] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - name: OceanBase Metrics [2023-02-21 14:59:25.679] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] type: file [2023-02-21 14:59:25.679] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] allowUiUpdates: 'true' [2023-02-21 14:59:25.679] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] options: [2023-02-21 14:59:25.679] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] path: /data/obdata/grafana/conf/provisioning/dashboards/templates to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 14:59:25.680] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 14:59:25.738] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:25.738] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- send /tmp/tmpwlnnvu4z to /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 14:59:25.784] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 14:59:25.808] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 14:59:25.811] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 14:59:25.896] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:25.896] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/247480/fd [2023-02-21 14:59:25.957] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:25.957] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: kill -9 247480 [2023-02-21 14:59:26.018] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:26.018] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/grafana; bash -c '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid > /data/obdata/grafana/data/log/grafana-console.log 2>&1 &' [2023-02-21 14:59:26.087] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:26.087] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 14:59:26.193] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:27.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] grafana program health check [2023-02-21 14:59:27.226] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:27.226] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:27.226] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:27.264] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:27.265] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:27.328] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:27.328] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:27.328] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:27.328] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 19 [2023-02-21 14:59:28.330] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:28.330] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:28.330] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:28.357] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:28.358] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:28.420] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:28.420] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:28.420] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:28.421] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 18 [2023-02-21 14:59:29.422] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:29.422] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:29.423] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:29.451] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:29.452] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:29.515] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:29.516] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:29.516] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:29.516] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 17 [2023-02-21 14:59:30.516] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:30.517] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:30.517] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:30.546] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:30.547] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:30.609] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:30.609] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:30.609] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:30.610] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 16 [2023-02-21 14:59:31.611] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:31.611] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:31.612] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:31.639] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:31.640] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:31.702] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:31.702] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:31.702] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:31.702] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 15 [2023-02-21 14:59:32.703] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:32.704] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:32.704] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:32.730] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:32.730] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:32.792] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:32.792] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:32.792] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:32.793] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 14 [2023-02-21 14:59:33.794] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:33.794] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:33.794] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:33.821] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:33.822] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:33.884] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:33.884] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:33.884] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:33.885] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 13 [2023-02-21 14:59:34.886] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:34.886] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:34.886] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:34.912] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:34.913] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:34.977] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:34.977] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:34.977] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:34.977] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 12 [2023-02-21 14:59:35.979] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:35.979] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:35.979] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:36.006] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:36.006] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:36.069] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:36.069] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:36.069] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:36.069] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 11 [2023-02-21 14:59:37.070] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:37.070] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:37.071] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:37.098] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:37.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:37.159] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:37.160] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:37.160] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:37.160] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 10 [2023-02-21 14:59:38.161] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:38.161] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:38.161] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:38.190] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:38.191] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:38.253] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:38.253] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:38.253] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:38.253] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 9 [2023-02-21 14:59:39.255] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:39.255] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:39.255] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:39.284] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:39.285] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:39.346] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:39.346] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:39.346] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:39.346] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 8 [2023-02-21 14:59:40.347] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:40.347] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:40.347] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:40.374] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:40.375] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:40.436] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:40.436] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:40.436] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:40.436] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 7 [2023-02-21 14:59:41.437] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:41.437] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:41.437] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:41.464] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:41.465] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:41.527] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:41.528] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:41.528] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:41.528] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 6 [2023-02-21 14:59:42.529] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:42.530] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:42.530] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:42.557] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:42.558] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:42.620] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:42.620] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:42.620] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:42.620] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 5 [2023-02-21 14:59:43.622] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:43.622] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:43.622] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:43.650] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:43.650] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:43.712] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:43.713] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:43.713] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:43.713] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 4 [2023-02-21 14:59:44.714] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:44.714] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:44.714] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:44.740] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:44.741] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:44.804] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:44.804] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:44.804] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:44.804] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 3 [2023-02-21 14:59:45.805] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:45.806] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:45.806] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:45.832] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:45.832] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:45.895] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:45.895] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:45.895] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:45.895] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 2 [2023-02-21 14:59:46.897] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:46.897] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:46.897] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:46.924] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:46.925] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:46.986] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:46.987] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:46.987] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:46.987] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 1 [2023-02-21 14:59:47.988] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 14:59:47.988] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7f23f3dc2518>: ['']} [2023-02-21 14:59:47.989] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 14:59:48.017] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:48.017] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104630267)\]' [2023-02-21 14:59:48.081] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 14:59:48.081] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 14:59:48.081] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] [2023-02-21 14:59:48.081] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 0 [2023-02-21 14:59:48.087] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [WARNING] [WARN] failed to start 10.253.208.63 grafana [2023-02-21 14:59:48.087] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 14:59:48.088] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export start [2023-02-21 14:59:48.088] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [ERROR] [ERROR] grafana start failed [2023-02-21 14:59:48.088] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 14:59:48.088] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import display [2023-02-21 14:59:48.093] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 14:59:48.094] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] Wait for observer init [2023-02-21 14:59:48.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 14:59:48.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | observer | [2023-02-21 14:59:48.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 14:59:48.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 14:59:48.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 14:59:48.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 14:59:48.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 14:59:48.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 14:59:48.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 14:59:48.099] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | observer | [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] [2023-02-21 14:59:48.225] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 14:59:48.226] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export display [2023-02-21 14:59:48.226] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 14:59:48.226] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import display [2023-02-21 14:59:48.231] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 14:59:48.242] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +-------------------------------------------------+ [2023-02-21 14:59:48.242] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | obproxy | [2023-02-21 14:59:48.242] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 14:59:48.242] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | ip | port | prometheus_port | status | [2023-02-21 14:59:48.242] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 14:59:48.242] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | 10.253.208.63 | 2883 | 2884 | active | [2023-02-21 14:59:48.242] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 14:59:48.243] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] obclient -h10.253.208.63 -P2883 -uroot -Doceanbase -A [2023-02-21 14:59:48.243] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 14:59:48.243] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export display [2023-02-21 14:59:48.243] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call obagent-py_script_display-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 14:59:48.243] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import display [2023-02-21 14:59:48.246] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 14:59:48.247] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.65:8088/metrics/stat" [2023-02-21 14:59:48.293] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:48.293] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.67:8088/metrics/stat" [2023-02-21 14:59:48.353] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:48.353] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.172:8088/metrics/stat" [2023-02-21 14:59:48.395] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 14:59:48.396] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +----------------------------------------------------+ [2023-02-21 14:59:48.396] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | obagent | [2023-02-21 14:59:48.396] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 14:59:48.396] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | ip | server_port | pprof_port | status | [2023-02-21 14:59:48.396] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 14:59:48.396] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | 10.253.208.65 | 8088 | 8089 | active | [2023-02-21 14:59:48.396] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | 10.253.208.67 | 8088 | 8089 | active | [2023-02-21 14:59:48.396] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | 10.253.208.172 | 8088 | 8089 | active | [2023-02-21 14:59:48.396] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 14:59:48.397] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 14:59:48.397] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export display [2023-02-21 14:59:48.397] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 14:59:48.397] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - import display [2023-02-21 14:59:48.400] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 14:59:48.401] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 14:59:48.404] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +------------------------------------------------------+ [2023-02-21 14:59:48.404] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | prometheus | [2023-02-21 14:59:48.404] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 14:59:48.404] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 14:59:48.404] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 14:59:48.404] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] | http://10.253.208.63:9090 | | | active | [2023-02-21 14:59:48.404] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 14:59:48.404] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 14:59:48.404] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - export display [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 14:59:48.405] [3d100a48-b1b5-11ed-a629-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 15:03:22.562] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 15:03:22.562] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 15:03:22.562] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 15:03:22.563] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 15:03:22.563] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'with_parameter': None} [2023-02-21 15:03:22.563] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 15:03:22.563] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 15:03:22.563] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 15:03:22.563] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 15:03:22.563] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 15:03:22.575] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Get local repositories and plugins [2023-02-21 15:03:22.623] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 15:03:22.623] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:22.624] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 15:03:22.624] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 15:03:22.626] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:22.626] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 15:03:22.629] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:22.629] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 15:03:22.632] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:22.632] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 15:03:22.634] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:22.634] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 15:03:22.637] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching restart plugin for components ... [2023-02-21 15:03:22.637] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching restart plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:22.637] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 15:03:22.639] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_restart-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:03:22.639] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching restart plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:22.639] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_restart-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:03:22.639] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching restart plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:22.639] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_restart-0.1 for obagent-1.2.0 [2023-02-21 15:03:22.639] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching restart plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:22.640] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_restart-2.37.1 for prometheus-2.37.1 [2023-02-21 15:03:22.640] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching restart plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:22.640] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_restart-7.5.17 for grafana-7.5.17 [2023-02-21 15:03:22.640] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching reload plugin for components ... [2023-02-21 15:03:22.640] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching reload plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:22.640] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_reload-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:03:22.640] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching reload plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:22.641] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_reload-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:03:22.641] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching reload plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:22.641] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_reload-0.1 for obagent-1.2.0 [2023-02-21 15:03:22.641] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching reload plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:22.641] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_reload-2.37.1 for prometheus-2.37.1 [2023-02-21 15:03:22.641] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching reload plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:22.641] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_reload-7.5.17 for grafana-7.5.17 [2023-02-21 15:03:22.641] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 15:03:22.641] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:22.642] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:03:22.642] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:22.642] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:03:22.642] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:22.642] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 15:03:22.642] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:22.643] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 15:03:22.643] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:22.643] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 15:03:22.643] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching stop plugin for components ... [2023-02-21 15:03:22.643] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:22.643] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:03:22.643] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:22.644] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:03:22.644] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching stop plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:22.644] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_stop-0.1 for obagent-1.2.0 [2023-02-21 15:03:22.644] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching stop plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:22.644] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_stop-2.37.1 for prometheus-2.37.1 [2023-02-21 15:03:22.644] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching stop plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:22.644] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_stop-7.5.17 for grafana-7.5.17 [2023-02-21 15:03:22.644] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 15:03:22.645] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:22.645] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:03:22.645] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:22.645] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:03:22.645] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:22.645] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 15:03:22.646] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:22.646] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 15:03:22.646] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:22.646] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 15:03:22.646] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 15:03:22.646] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:22.646] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:03:22.647] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:22.647] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:03:22.647] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:22.647] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 15:03:22.647] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:22.647] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 15:03:22.647] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:22.647] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 15:03:22.647] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 15:03:22.648] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:22.648] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:03:22.648] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:22.648] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:03:22.648] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:22.649] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 15:03:22.649] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:22.649] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 15:03:22.649] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:22.649] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 15:03:22.713] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 15:03:22.713] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 15:03:22.713] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 15:03:22.714] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:03:22.714] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:23.444] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 15:03:23.444] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:03:23.445] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:23.611] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 15:03:23.611] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 15:03:23.611] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:23.709] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 15:03:23.709] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 15:03:23.709] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:23.731] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 15:03:23.732] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 15:03:23.732] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:23.863] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 15:03:24.907] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Cluster status check [2023-02-21 15:03:24.907] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching status plugin for components ... [2023-02-21 15:03:24.907] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching status plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:24.908] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:03:24.908] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching status plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:24.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:03:24.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching status plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:24.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_status-0.1 for obagent-1.2.0 [2023-02-21 15:03:24.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching status plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:24.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_status-2.37.1 for prometheus-2.37.1 [2023-02-21 15:03:24.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Searching status plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:24.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_status-7.5.17 for grafana-7.5.17 [2023-02-21 15:03:24.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:24.910] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:03:24.913] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:03:24.913] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:25.001] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.002] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/118859 [2023-02-21 15:03:25.068] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.068] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:25.096] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.096] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/25791 [2023-02-21 15:03:25.167] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.168] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:25.193] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.193] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/211348 [2023-02-21 15:03:25.259] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.259] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:03:25.259] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:03:25.260] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:25.260] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:03:25.263] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:03:25.264] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:03:25.290] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.290] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/246996 [2023-02-21 15:03:25.350] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.350] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:03:25.350] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:03:25.351] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Call obagent-py_script_status-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:03:25.351] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:03:25.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:03:25.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:03:25.379] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.379] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/119875 [2023-02-21 15:03:25.444] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.445] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:03:25.464] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.464] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/26733 [2023-02-21 15:03:25.524] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.524] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:03:25.552] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.552] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/212299 [2023-02-21 15:03:25.652] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.652] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:03:25.652] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:03:25.653] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_status-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:03:25.653] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:03:25.656] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:03:25.656] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:03:25.676] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.677] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/33759 [2023-02-21 15:03:25.735] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.736] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:03:25.736] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:03:25.736] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Call grafana-py_script_status-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:03:25.736] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:03:25.739] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:03:25.739] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:03:25.794] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.794] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/33991 [2023-02-21 15:03:25.853] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:03:25.854] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:03:25.854] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:03:25.951] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_restart-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:25.951] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:03:25.958] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:03:25.958] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:25.959] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Connect to observer [2023-02-21 15:03:25.959] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:03:25.997] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:03:25.997] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 15:03:25.999] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:03:25.999] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:03:26.090] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:03:26.090] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:03:26.091] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: set session ob_query_timeout=1000000000. args: None [2023-02-21 15:03:26.091] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2023-02-21 15:03:26.092] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Server check [2023-02-21 15:03:26.093] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server. args: None [2023-02-21 15:03:26.093] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server [2023-02-21 15:03:26.095] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- [{'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 101577), 'gmt_modified': datetime.datetime(2023, 2, 21, 11, 32, 55, 735429), 'svr_ip': '10.253.208.172', 'svr_port': 2882, 'id': 3, 'zone': 'zone3', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 1676950373729506, 'first_sessid': 0, 'with_partition': 1}, {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 223333), 'gmt_modified': datetime.datetime(2023, 2, 21, 11, 32, 54, 588633), 'svr_ip': '10.253.208.65', 'svr_port': 2882, 'id': 1, 'zone': 'zone1', 'inner_port': 2881, 'with_rootserver': 1, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 1676950367595862, 'first_sessid': 0, 'with_partition': 1}, {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 100518), 'gmt_modified': datetime.datetime(2023, 2, 21, 11, 32, 53, 167277), 'svr_ip': '10.253.208.67', 'svr_port': 2882, 'id': 2, 'zone': 'zone2', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 1676950372175406, 'first_sessid': 0, 'with_partition': 1}] [2023-02-21 15:03:26.224] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Observer restart [2023-02-21 15:03:26.224] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:26.224] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:03:26.230] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:03:26.230] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:26.256] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:26.256] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ps uax | egrep " 118859 " | grep -v grep [2023-02-21 15:03:26.358] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:26.358] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) observer[pid:118859] stopping ... [2023-02-21 15:03:26.359] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: kill -9 118859 [2023-02-21 15:03:26.422] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:26.422] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:26.443] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:26.443] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ps uax | egrep " 25791 " | grep -v grep [2023-02-21 15:03:26.557] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:26.557] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) observer[pid:25791] stopping ... [2023-02-21 15:03:26.557] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: kill -9 25791 [2023-02-21 15:03:26.620] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:26.620] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:26.645] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:26.645] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ps uax | egrep " 211348 " | grep -v grep [2023-02-21 15:03:26.740] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:26.740] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) observer[pid:211348] stopping ... [2023-02-21 15:03:26.741] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: kill -9 211348 [2023-02-21 15:03:26.806] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:27.807] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) check whether the port is released [2023-02-21 15:03:27.807] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:27.837] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:27.838] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:27.906] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:27.907] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 15:03:27.969] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:27.970] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) observer is stopped [2023-02-21 15:03:27.970] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) check whether the port is released [2023-02-21 15:03:27.970] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:27.995] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:27.995] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:28.056] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:28.056] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 15:03:28.122] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:28.122] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) observer is stopped [2023-02-21 15:03:28.122] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) check whether the port is released [2023-02-21 15:03:28.123] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:28.158] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:28.158] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:28.234] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:28.234] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 15:03:28.301] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:28.301] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) observer is stopped [2023-02-21 15:03:28.302] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:03:28.302] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:03:28.302] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:28.302] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:03:28.304] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:03:28.304] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:28.328] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:03:28.328] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 15:03:28.328] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:03:28.328] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) start command construction [2023-02-21 15:03:28.328] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 15:03:28.392] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:28.393] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:28.415] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:03:28.416] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 15:03:28.416] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:03:28.416] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) start command construction [2023-02-21 15:03:28.416] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 15:03:28.475] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:28.475] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:28.499] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:03:28.499] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 15:03:28.500] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:03:28.500] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) start command construction [2023-02-21 15:03:28.500] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 15:03:28.565] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:28.566] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- starting server1(10.253.208.65) observer [2023-02-21 15:03:28.566] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 15:03:28.567] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 15:03:28.741] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:28.742] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 delete env LD_LIBRARY_PATH [2023-02-21 15:03:28.742] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- starting server2(10.253.208.67) observer [2023-02-21 15:03:28.743] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 15:03:28.743] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 15:03:28.882] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:28.882] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 delete env LD_LIBRARY_PATH [2023-02-21 15:03:28.883] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- starting server3(10.253.208.172) observer [2023-02-21 15:03:28.883] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 15:03:28.883] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 15:03:29.954] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:29.954] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 delete env LD_LIBRARY_PATH [2023-02-21 15:03:32.957] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) program health check [2023-02-21 15:03:32.957] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:32.985] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:32.985] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ls /proc/141345 [2023-02-21 15:03:33.049] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:33.049] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) observer[pid: 141345] started [2023-02-21 15:03:33.050] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) program health check [2023-02-21 15:03:33.050] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:33.084] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:33.084] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ls /proc/47234 [2023-02-21 15:03:33.165] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:33.165] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) observer[pid: 47234] started [2023-02-21 15:03:33.165] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) program health check [2023-02-21 15:03:33.166] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:03:33.233] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:33.234] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ls /proc/238886 [2023-02-21 15:03:33.323] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:33.323] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) observer[pid: 238886] started [2023-02-21 15:03:33.323] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:03:33.323] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:03:33.323] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: select version(). args: None [2023-02-21 15:03:33.323] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: select version() [2023-02-21 15:03:33.325] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:03:33.325] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:03:33.325] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:03:33.325] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:03:33.325] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:03:33.325] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:03:33.325] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:03:33.325] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:03:33.325] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:03:33.325] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 59, in connect [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if self.cursor is None or self.execute_sql('select version()', error=False) is False: [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 692, in _read_packet [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] packet_header = self._read_bytes(4) [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 749, in _read_bytes [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] CR.CR_SERVER_LOST, "Lost connection to MySQL server during query" [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query') [2023-02-21 15:03:33.326] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] [2023-02-21 15:03:33.327] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:03:33.327] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 15:03:33.329] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:03:33.329] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:03:33.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:03:33.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] [2023-02-21 15:03:35.335] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:03:35.336] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:03:35.337] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:03:35.337] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:03:35.337] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:03:35.338] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:03:35.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:03:35.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:03:35.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:03:35.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:03:35.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] [2023-02-21 15:03:37.341] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:03:37.341] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:03:37.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:03:37.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] [2023-02-21 15:03:39.346] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:03:39.346] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:03:39.348] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:03:39.349] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] [2023-02-21 15:03:41.351] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:03:41.351] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:03:41.353] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:03:41.353] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:03:41.353] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:03:41.354] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:03:41.355] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] [2023-02-21 15:03:43.357] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:03:43.358] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:03:43.360] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:03:43.361] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] [2023-02-21 15:03:45.363] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:03:45.364] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:03:45.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:03:45.368] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [ERROR] [2023-02-21 15:03:47.371] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:03:47.371] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:03:47.372] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: set session ob_query_timeout=1000000000. args: None [2023-02-21 15:03:47.372] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2023-02-21 15:03:47.372] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- server check [2023-02-21 15:03:47.373] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0. args: None [2023-02-21 15:03:47.373] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0 [2023-02-21 15:03:47.377] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 101577), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 3, 46, 371691), 'svr_ip': '10.253.208.172', 'svr_port': 2882, 'id': 3, 'zone': 'zone3', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 0, 'first_sessid': 0, 'with_partition': 1} [2023-02-21 15:03:50.380] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0. args: None [2023-02-21 15:03:50.380] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0 [2023-02-21 15:03:50.382] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 101577), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 3, 46, 371691), 'svr_ip': '10.253.208.172', 'svr_port': 2882, 'id': 3, 'zone': 'zone3', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 0, 'first_sessid': 0, 'with_partition': 1} [2023-02-21 15:03:53.385] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0. args: None [2023-02-21 15:03:53.385] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0 [2023-02-21 15:03:53.468] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- query: select version(). args: None [2023-02-21 15:03:53.468] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- execute sql: select version() [2023-02-21 15:03:53.470] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- {'version()': '5.7.25-OceanBase_CE-v4.0.0.0'} [2023-02-21 15:03:53.470] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:03:53.471] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:03:53.471] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Wait for observer init [2023-02-21 15:03:53.476] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 15:03:53.476] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | observer | [2023-02-21 15:03:53.476] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:03:53.477] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 15:03:53.477] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:03:53.477] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 15:03:53.477] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 15:03:53.477] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 15:03:53.477] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:03:53.477] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 15:03:53.602] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 15:03:53.602] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | observer | [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:03:53.603] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_restart-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:53.604] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:03:53.609] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:03:53.609] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:53.609] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:03:53.614] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:03:53.615] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Stop obproxy [2023-02-21 15:03:53.615] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:03:53.636] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:53.636] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/246996 [2023-02-21 15:03:53.695] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:53.697] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/246996/fd [2023-02-21 15:03:53.756] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:53.756] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 obproxy[pid:246996] stopping ... [2023-02-21 15:03:53.756] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid | xargs kill -9; kill -9 -246996 [2023-02-21 15:03:53.827] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:54.829] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 check whether the port is released [2023-02-21 15:03:54.829] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:54.854] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:54.854] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:54.916] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:54.917] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: rm -f /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:03:54.977] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:54.977] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 obproxy is stopped [2023-02-21 15:03:55.050] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:03:55.050] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:03:55.050] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:03:55.050] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:03:55.052] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:03:55.054] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Start obproxy [2023-02-21 15:03:55.055] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/obproxy/etc/obproxy_config.bin [2023-02-21 15:03:55.076] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:55.076] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 port check [2023-02-21 15:03:55.076] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:03:55.136] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:03:55.136] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 15:03:55.136] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:03:55.136] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- starting 10.253.208.63 obproxy [2023-02-21 15:03:55.136] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/obproxy/lib:' [2023-02-21 15:03:55.137] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/obproxy; /data/obdata/obproxy/bin/obproxy --listen_port 2883 [2023-02-21 15:03:55.334] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:55.335] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 delete env LD_LIBRARY_PATH [2023-02-21 15:03:55.335] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/obproxy/bin/obproxy --listen_port 2883$' | grep -v grep | awk '{print $2}' > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:03:55.431] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:55.447] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] obproxy program health check [2023-02-21 15:03:55.448] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:03:55.448] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:03:55.493] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:55.494] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:55.560] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:55.560] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 19 [2023-02-21 15:03:56.561] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:03:56.561] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:03:56.585] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:56.585] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:56.649] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:56.650] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 18 [2023-02-21 15:03:57.651] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:03:57.651] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:03:57.674] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:57.674] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:57.737] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:57.738] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 2104648739 [2023-02-21 15:03:57.738] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:03:57.738] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/36384/fd/ |grep -E 'socket:\[(2104648739)\]' [2023-02-21 15:03:57.802] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:57.803] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 15:03:57.865] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 2, error output: [2023-02-21 15:03:57.865] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/246974: 没有那个文件或目录 [2023-02-21 15:03:57.865] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:03:57.865] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: echo 36384 > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:03:57.926] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:58.008] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:03:58.008] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/obproxy && rm -fr /data/obdata/obproxy/obproxyd.sh [2023-02-21 15:03:58.030] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:58.031] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /home/admin/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /data/obdata/obproxy/obproxyd.sh [2023-02-21 15:03:58.074] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/obproxy/obproxyd.sh [2023-02-21 15:03:58.095] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:03:58.096] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash /data/obdata/obproxy/obproxyd.sh /data/obdata/obproxy 10.253.208.63 2883 [2023-02-21 15:03:58.161] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:59.162] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:03:59.162] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:03:59.185] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:59.186] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:03:59.251] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:03:59.251] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 16 [2023-02-21 15:04:00.253] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:04:00.253] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:04:00.276] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:00.277] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:00.345] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:00.345] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 15 [2023-02-21 15:04:01.346] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:04:01.346] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:04:01.370] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:01.371] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:01.434] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:01.434] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 2104648861 [2023-02-21 15:04:01.434] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:04:01.435] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/36638/fd/ |grep -E 'socket:\[(2104648861)\]' [2023-02-21 15:04:01.498] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:01.498] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 15:04:01.566] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:01.567] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 obproxy[pid: 36638] started [2023-02-21 15:04:01.578] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:04:01.578] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:04:01.578] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:04:01.579] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Connect to obproxy [2023-02-21 15:04:01.579] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:04:01.581] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:04:01.581] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- connect 10.253.208.63 -P2883 -uroot@proxysys -p [2023-02-21 15:04:01.584] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:04:01.584] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:04:01.710] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:04:01.711] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:04:01.712] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:04:01.723] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +-------------------------------------------------+ [2023-02-21 15:04:01.723] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | obproxy | [2023-02-21 15:04:01.723] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | ip | port | prometheus_port | status | [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | 10.253.208.63 | 2883 | 2884 | active | [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] obclient -h10.253.208.63 -P2883 -uroot -Doceanbase -A [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Call obagent-py_script_restart-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:04:01.724] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:04:01.730] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:04:01.730] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call obagent-py_script_stop-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:04:01.730] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:04:01.734] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:04:01.735] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Stop obagent [2023-02-21 15:04:01.735] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:04:01.760] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:01.760] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ls /proc/119875 [2023-02-21 15:04:01.823] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:01.824] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) obagent[pid:119875] stopping ... [2023-02-21 15:04:01.824] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: kill -9 119875 [2023-02-21 15:04:01.888] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:01.888] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:04:01.967] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:01.967] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ls /proc/26733 [2023-02-21 15:04:02.035] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:02.036] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) obagent[pid:26733] stopping ... [2023-02-21 15:04:02.036] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: kill -9 26733 [2023-02-21 15:04:02.096] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:02.096] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:04:02.161] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:02.162] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ls /proc/212299 [2023-02-21 15:04:02.230] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:02.231] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) obagent[pid:212299] stopping ... [2023-02-21 15:04:02.231] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: kill -9 212299 [2023-02-21 15:04:02.309] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:03.311] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) check whether the port is released [2023-02-21 15:04:03.311] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:03.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:03.344] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:03.414] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:03.414] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:04:03.476] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:03.476] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) obagent is stopped [2023-02-21 15:04:03.476] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) check whether the port is released [2023-02-21 15:04:03.477] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:03.513] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:03.514] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:03.579] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:03.580] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:04:03.639] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:03.640] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) obagent is stopped [2023-02-21 15:04:03.640] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) check whether the port is released [2023-02-21 15:04:03.640] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:03.683] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:03.684] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:03.758] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:03.758] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:04:03.823] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:03.824] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) obagent is stopped [2023-02-21 15:04:03.952] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:04:03.952] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:04:03.953] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:04:03.953] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:04:04.044] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:04:04.045] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Start obagent [2023-02-21 15:04:04.082] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:04:04.106] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:04:04.106] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 15:04:04.106] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:04:04.106] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:04.193] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:04:04.193] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:04.216] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:04.217] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmppj329k3t.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:04.261] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:04.284] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:04.287] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:04.288] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:04.350] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:04.350] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp6bps4g7m.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:04.396] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:04.420] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:04.424] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:04.425] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:04.486] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:04.486] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpf08v6gm6.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:04.532] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:04.556] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:04.558] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 15:04:04.559] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:04:04.622] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:04.622] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp20dj_m8_.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:04:04.667] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:04:04.691] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:04.694] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:04.694] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:04.757] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:04.757] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpq9ppneqn.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:04.802] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:04.826] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:04.829] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:04.830] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:04.891] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:04.892] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpjc1rno0e.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:04.938] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:04.960] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:04.964] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:04.964] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:05.026] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:05.026] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpf_jkonf3.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:05.076] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:05.101] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:05.107] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:05.108] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:05.165] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:05.166] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpaxd5ydvd.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:05.211] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:05.233] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:05.236] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:05.237] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:05.297] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:05.298] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmprpr4sc2v.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:05.343] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:05.365] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:05.374] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:04:05.429] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:05.429] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpbg1iqid1.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:04:05.474] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:04:05.496] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:05.499] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:04:05.557] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:05.557] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:04:05.577] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:04:05.578] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 15:04:05.578] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:04:05.579] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:05.667] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:04:05.668] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:05.696] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:05.697] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpq9zj6mr0.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:05.747] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:05.775] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:05.778] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:05.779] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:05.837] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:05.837] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpnt2ckkbu.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:05.886] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:05.907] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:05.911] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:05.912] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:05.976] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:05.977] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpdqgrgs4p.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:06.025] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:06.049] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:06.053] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 15:04:06.054] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:04:06.125] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:06.126] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpq47gfgvp.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:04:06.173] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:04:06.195] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:06.197] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:06.198] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:06.259] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:06.260] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpho9ej05e.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:06.308] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:06.331] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:06.333] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:06.334] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:06.396] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:06.396] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpo9dopfs5.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:06.445] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:06.465] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:06.469] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:06.470] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:06.528] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:06.528] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp9rncjq66.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:06.584] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:06.606] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:06.611] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:06.611] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:06.667] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:06.668] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp7e9uum2g.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:06.715] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:06.736] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:06.740] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:06.741] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:06.798] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:06.799] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpico385q2.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:06.847] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:06.868] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:06.874] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:04:06.931] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:06.931] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmppm19dgp0.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:04:06.979] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:04:07.001] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:07.004] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:04:07.084] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:07.085] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:04:07.108] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:04:07.108] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 15:04:07.108] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:04:07.109] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:07.192] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:04:07.193] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:07.218] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:07.218] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp3korniyl.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:07.265] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:04:07.300] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:07.304] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:07.304] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:07.366] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:07.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp88qgt2i3.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:07.412] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:04:07.440] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:07.444] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:07.445] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:07.505] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:07.505] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpcn6hw_ut.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:07.550] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:04:07.579] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:07.582] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 15:04:07.583] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:04:07.648] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:07.648] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp_osvwjwp.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:04:07.692] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:04:07.730] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:07.732] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:07.732] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:07.794] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:07.795] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpr1ymrw90.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:07.841] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:04:07.873] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:07.876] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:07.877] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:07.937] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:07.938] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpsxjshhv7.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:07.984] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:04:08.008] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:08.011] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:08.012] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:08.083] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:08.084] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpy3cimfvg.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:08.131] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:04:08.155] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:08.160] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:08.161] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:08.220] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:08.220] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpwuvhdl_c.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:08.265] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:04:08.295] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:08.298] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:08.299] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:08.362] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:08.363] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp1rohug85.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:08.408] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:04:08.433] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:08.441] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:04:08.503] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:08.504] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpc3k9ih6x.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:04:08.549] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:04:08.573] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:08.577] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:04:08.639] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:08.739] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] obagent program health check [2023-02-21 15:04:09.741] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) program health check [2023-02-21 15:04:09.741] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:04:09.763] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:09.764] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:09.833] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:09.834] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) program health check [2023-02-21 15:04:09.834] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:04:09.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:09.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:10.048] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:10.048] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) program health check [2023-02-21 15:04:10.048] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:04:10.084] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:10.084] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:10.168] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:10.168] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- start to sync target config [2023-02-21 15:04:10.174] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:04:10.174] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:04:10.174] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:04:10.175] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:04:10.175] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.65:8088/metrics/stat" [2023-02-21 15:04:10.215] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:10.215] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.67:8088/metrics/stat" [2023-02-21 15:04:10.289] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:10.290] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.172:8088/metrics/stat" [2023-02-21 15:04:10.337] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +----------------------------------------------------+ [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | obagent | [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | ip | server_port | pprof_port | status | [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | 10.253.208.65 | 8088 | 8089 | active | [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | 10.253.208.67 | 8088 | 8089 | active | [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | 10.253.208.172 | 8088 | 8089 | active | [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:04:10.339] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:04:10.340] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:04:10.340] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_restart-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:04:10.340] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:04:10.347] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:04:10.347] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_stop-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:04:10.347] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:04:10.352] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:04:10.353] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Stop prometheus [2023-02-21 15:04:10.353] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:04:10.378] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:10.378] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/33759 [2023-02-21 15:04:10.440] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:10.441] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/33759/fd [2023-02-21 15:04:10.500] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:10.500] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 prometheus[pid:33759] stopping... [2023-02-21 15:04:10.501] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheusd.pid | xargs kill -9; kill -9 33759 [2023-02-21 15:04:10.562] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:11.564] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 check whether the port is released [2023-02-21 15:04:11.564] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:11.593] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:11.594] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: rm -f /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:04:11.658] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:11.659] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 prometheus is stopped [2023-02-21 15:04:11.787] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:04:11.788] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:04:11.788] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:04:11.788] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:04:11.791] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:04:11.791] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Start promethues [2023-02-21 15:04:11.792] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/prometheus/.prometheus_started [2023-02-21 15:04:11.813] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:11.814] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:04:11.875] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:11.875] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:04:11.937] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- write global: [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] scrape_interval: 1s [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] evaluation_interval: 10s [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] rule_files: [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - rules/*rules.yaml [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] scrape_configs: [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - job_name: prometheus [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] metrics_path: /metrics [2023-02-21 15:04:11.971] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.63:9090 [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - job_name: node [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] metrics_path: /metrics/node/host [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - job_name: ob_basic [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/basic [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:04:11.972] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - job_name: ob_extra [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/extra [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - job_name: agent [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:04:11.973] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] metrics_path: /metrics/stat [2023-02-21 15:04:11.974] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:04:11.974] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:04:11.974] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:04:11.974] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:04:11.974] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:04:11.974] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:04:11.974] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:04:11.974] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:04:11.974] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - targets/*.yaml to admin@10.253.208.63:22: /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:04:11.974] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:04:11.999] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:12.000] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpcdqkruh2 to /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:04:12.046] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:04:12.070] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:12.074] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:04:12.135] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:12.136] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:04:12.180] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:04:12.203] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:12.204] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle --start-only [2023-02-21 15:04:12.312] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:12.312] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheus.pid` && ls /proc/$pid [2023-02-21 15:04:12.382] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:13.447] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] prometheus program health check [2023-02-21 15:04:13.448] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:04:13.448] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:04:13.472] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:13.472] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:13.540] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:13.540] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 2104642501 [2023-02-21 15:04:13.540] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:04:13.540] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/37012/fd/ |grep -E 'socket:\[(2104642501)\]' [2023-02-21 15:04:13.611] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:13.611] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 15:04:13.680] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 2, error output: [2023-02-21 15:04:13.680] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/33724: 没有那个文件或目录 [2023-02-21 15:04:13.680] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:04:13.681] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:04:13.742] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:13.742] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:04:13.786] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:04:13.807] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:13.808] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle [2023-02-21 15:04:13.886] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:14.888] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:04:14.888] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:04:14.909] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:14.910] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:14.979] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:14.979] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 prometheus, remaining retries: 18 [2023-02-21 15:04:15.980] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:04:15.981] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:04:16.005] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:16.005] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:16.075] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:16.075] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 2104645609 [2023-02-21 15:04:16.075] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:04:16.075] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/37177/fd/ |grep -E 'socket:\[(2104645609)\]' [2023-02-21 15:04:16.145] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:16.145] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 15:04:16.218] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:16.219] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 prometheusd[pid: 37177] started [2023-02-21 15:04:16.320] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:04:16.320] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:04:16.321] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:04:16.321] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Connect to prometheus [2023-02-21 15:04:16.322] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:04:16.323] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:04:16.324] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- connect prometheus (10.253.208.63:9090 by user None) [2023-02-21 15:04:16.324] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 15:04:16.331] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:04:16.332] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:04:16.453] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:04:16.453] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:04:16.454] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:04:16.454] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 15:04:16.459] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +------------------------------------------------------+ [2023-02-21 15:04:16.459] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | prometheus | [2023-02-21 15:04:16.459] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:04:16.459] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 15:04:16.459] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:04:16.459] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | http://10.253.208.63:9090 | | | active | [2023-02-21 15:04:16.460] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:04:16.460] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:04:16.460] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:04:16.460] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:04:16.460] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:04:16.460] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Call grafana-py_script_restart-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:04:16.460] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:04:16.468] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:04:16.468] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call grafana-py_script_stop-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:04:16.468] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:04:16.473] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:04:16.474] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Stop grafana [2023-02-21 15:04:16.474] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:04:16.496] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:16.497] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/33991 [2023-02-21 15:04:16.558] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:16.559] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/33991/fd [2023-02-21 15:04:16.619] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:16.620] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 grafana[pid:33991] stopping... [2023-02-21 15:04:16.620] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: kill -9 33991 [2023-02-21 15:04:16.677] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:17.679] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 check whether the port is released [2023-02-21 15:04:17.679] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:17.705] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:17.706] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 grafana is stopped [2023-02-21 15:04:17.779] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:04:17.779] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:04:17.780] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:04:17.780] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:04:17.783] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:04:17.783] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Start grafana [2023-02-21 15:04:17.784] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 generate obd-grafana ini file [2023-02-21 15:04:17.785] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf && rm -fr /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:04:17.809] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:17.810] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp8kd573j0.ini to /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:04:17.855] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:04:17.876] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:17.879] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 generate datasources yaml [2023-02-21 15:04:17.882] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- write apiVersion: 1 [2023-02-21 15:04:17.882] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] datasources: [2023-02-21 15:04:17.882] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - name: OB-Prometheus [2023-02-21 15:04:17.882] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] isDefault: 'true' [2023-02-21 15:04:17.882] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] type: prometheus [2023-02-21 15:04:17.882] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] access: proxy [2023-02-21 15:04:17.882] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] editable: 'true' [2023-02-21 15:04:17.882] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] url: http://10.253.208.63:9090 to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:04:17.883] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/datasources && rm -fr /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:04:17.941] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:17.942] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpz0kok4xw to /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:04:17.987] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:04:18.009] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:18.011] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 generate providers yaml [2023-02-21 15:04:18.014] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- write apiVersion: 1 [2023-02-21 15:04:18.014] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] providers: [2023-02-21 15:04:18.014] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - name: OceanBase Metrics [2023-02-21 15:04:18.014] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] type: file [2023-02-21 15:04:18.014] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] allowUiUpdates: 'true' [2023-02-21 15:04:18.014] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] options: [2023-02-21 15:04:18.014] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] path: /data/obdata/grafana/conf/provisioning/dashboards/templates to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:04:18.015] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:04:18.072] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:18.073] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpy20qx_30 to /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:04:18.119] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:04:18.141] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:04:18.143] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 15:04:18.220] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:18.221] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/grafana; bash -c '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid > /data/obdata/grafana/data/log/grafana-console.log 2>&1 &' [2023-02-21 15:04:18.287] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:18.287] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 15:04:18.367] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:19.438] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] grafana program health check [2023-02-21 15:04:19.438] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:04:19.438] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7fe830dad860>: ['37451']} [2023-02-21 15:04:19.438] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:04:19.464] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:19.465] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/37451/fd/ |grep -E 'socket:\[(2104650897)\]' [2023-02-21 15:04:19.527] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:19.527] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:04:19.589] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:04:19.590] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 grafana[pid: 37451] started [2023-02-21 15:04:19.700] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:04:19.700] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:04:19.700] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call grafana-py_script_connect-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:04:19.701] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] Connect to Grafana [2023-02-21 15:04:19.701] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:04:19.707] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:04:19.707] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/grafana/run/.grafana [2023-02-21 15:04:19.731] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- exited code 2, error output: [2023-02-21 15:04:19.731] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ls: 无法访问/data/obdata/grafana/run/.grafana: 没有那个文件或目录 [2023-02-21 15:04:19.732] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] [2023-02-21 15:04:19.732] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- connect grafana (10.253.208.63:3000 by user admin) [2023-02-21 15:04:19.732] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:04:19.732] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:04:19.832] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] -- Call grafana-py_script_display-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:04:19.832] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:04:19.835] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:04:19.836] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- type: [2023-02-21 15:04:19.836] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- send http request method: GET, url: http://10.253.208.63:3000/api/dashboards/tags, data: None [2023-02-21 15:04:19.865] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] ---- request grafana failed: b'{"message":"invalid username or password"}' [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +---------------------------------------------------------------------+ [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | grafana | [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +---------------------------------------+-------+----------+----------+ [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +---------------------------------------+-------+----------+----------+ [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] | http://10.253.208.63:3000/d/oceanbase | admin | admin | inactive | [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] +---------------------------------------+-------+----------+----------+ [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:04:19.866] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - Set observer deploy status to running [2023-02-21 15:04:19.867] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 15:04:19.873] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [INFO] observer restart [2023-02-21 15:04:19.873] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 15:04:19.873] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 15:04:19.873] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 15:04:19.873] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 15:04:19.873] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 15:04:19.873] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 15:04:19.873] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 15:04:19.874] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 15:04:19.874] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 15:04:19.874] [d4322d16-b1b5-11ed-be31-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 15:13:10.837] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 15:13:10.838] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 15:13:10.838] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 15:13:10.838] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 15:13:10.838] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'with_parameter': None} [2023-02-21 15:13:10.838] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 15:13:10.839] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 15:13:10.839] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 15:13:10.839] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 15:13:10.839] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 15:13:10.850] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Get local repositories and plugins [2023-02-21 15:13:10.894] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 15:13:10.894] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:10.894] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 15:13:10.894] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 15:13:10.897] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:10.897] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 15:13:10.899] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:10.900] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 15:13:10.902] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:10.902] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 15:13:10.904] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:10.905] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 15:13:10.907] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching restart plugin for components ... [2023-02-21 15:13:10.907] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching restart plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:10.908] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 15:13:10.909] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_restart-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:13:10.909] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching restart plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:10.909] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_restart-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:13:10.909] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching restart plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:10.909] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_restart-0.1 for obagent-1.2.0 [2023-02-21 15:13:10.910] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching restart plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:10.910] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_restart-2.37.1 for prometheus-2.37.1 [2023-02-21 15:13:10.910] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching restart plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:10.910] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_restart-7.5.17 for grafana-7.5.17 [2023-02-21 15:13:10.910] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching reload plugin for components ... [2023-02-21 15:13:10.910] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching reload plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:10.911] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_reload-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:13:10.911] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching reload plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:10.911] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_reload-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:13:10.911] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching reload plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:10.911] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_reload-0.1 for obagent-1.2.0 [2023-02-21 15:13:10.911] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching reload plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:10.911] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_reload-2.37.1 for prometheus-2.37.1 [2023-02-21 15:13:10.911] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching reload plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:10.912] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_reload-7.5.17 for grafana-7.5.17 [2023-02-21 15:13:10.912] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 15:13:10.912] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:10.912] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:13:10.912] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:10.912] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:13:10.912] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:10.913] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 15:13:10.913] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:10.913] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 15:13:10.913] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:10.913] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 15:13:10.913] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching stop plugin for components ... [2023-02-21 15:13:10.913] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:10.914] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:13:10.914] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:10.914] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:13:10.914] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching stop plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:10.914] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_stop-0.1 for obagent-1.2.0 [2023-02-21 15:13:10.914] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching stop plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:10.915] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_stop-2.37.1 for prometheus-2.37.1 [2023-02-21 15:13:10.915] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching stop plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:10.915] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_stop-7.5.17 for grafana-7.5.17 [2023-02-21 15:13:10.915] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 15:13:10.915] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:10.915] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:13:10.915] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:10.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:13:10.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:10.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 15:13:10.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:10.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 15:13:10.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:10.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 15:13:10.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 15:13:10.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:10.917] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:13:10.917] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:10.917] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:13:10.917] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:10.917] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 15:13:10.918] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:10.918] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 15:13:10.918] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:10.918] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 15:13:10.918] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 15:13:10.918] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:10.918] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:13:10.919] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:10.919] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:13:10.919] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:10.919] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 15:13:10.919] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:10.919] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 15:13:10.919] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:10.919] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 15:13:10.981] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 15:13:10.982] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 15:13:10.982] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 15:13:10.983] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:13:10.983] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:11.667] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 15:13:11.668] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:13:11.668] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:11.833] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 15:13:11.834] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 15:13:11.834] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:11.932] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 15:13:11.932] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 15:13:11.932] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:11.954] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 15:13:11.954] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 15:13:11.954] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:12.013] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 15:13:13.189] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Cluster status check [2023-02-21 15:13:13.189] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching status plugin for components ... [2023-02-21 15:13:13.189] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching status plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:13.190] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:13:13.190] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching status plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:13.191] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:13:13.191] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching status plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:13.191] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_status-0.1 for obagent-1.2.0 [2023-02-21 15:13:13.191] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching status plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:13.191] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_status-2.37.1 for prometheus-2.37.1 [2023-02-21 15:13:13.191] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Searching status plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:13.191] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_status-7.5.17 for grafana-7.5.17 [2023-02-21 15:13:13.191] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:13.192] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:13:13.192] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:13:13.193] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:13.230] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.230] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/141345 [2023-02-21 15:13:13.296] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.297] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:13.354] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.354] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/47234 [2023-02-21 15:13:13.416] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.417] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:13.450] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.451] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/238886 [2023-02-21 15:13:13.515] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.516] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:13:13.516] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:13:13.516] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:13.516] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:13:13.517] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:13:13.518] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:13.540] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.540] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/36638 [2023-02-21 15:13:13.599] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:13:13.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:13:13.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Call obagent-py_script_status-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:13.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:13:13.601] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:13:13.601] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:13:13.625] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.626] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/142282 [2023-02-21 15:13:13.690] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.690] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:13:13.712] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.712] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/48166 [2023-02-21 15:13:13.795] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.796] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:13:13.820] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.821] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/239923 [2023-02-21 15:13:13.914] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.914] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:13:13.914] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:13:13.914] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_status-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:13:13.915] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:13:13.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:13:13.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:13:13.937] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:13.937] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/37177 [2023-02-21 15:13:13.999] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:14.000] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:13:14.000] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:13:14.000] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Call grafana-py_script_status-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:13:14.000] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:13:14.001] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:13:14.001] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:13:14.058] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:14.059] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/37451 [2023-02-21 15:13:14.118] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:13:14.118] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:13:14.119] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:13:14.234] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_restart-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:14.234] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:13:14.237] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:13:14.238] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:14.238] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Connect to observer [2023-02-21 15:13:14.239] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:13:14.291] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:13:14.292] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 15:13:14.294] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:13:14.294] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:13:14.370] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:13:14.370] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:13:14.371] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: set session ob_query_timeout=1000000000. args: None [2023-02-21 15:13:14.371] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2023-02-21 15:13:14.372] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Server check [2023-02-21 15:13:14.373] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server. args: None [2023-02-21 15:13:14.373] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server [2023-02-21 15:13:14.375] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- [{'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 101577), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 3, 52, 968186), 'svr_ip': '10.253.208.172', 'svr_port': 2882, 'id': 3, 'zone': 'zone3', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 1676963030974081, 'first_sessid': 0, 'with_partition': 1}, {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 223333), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 3, 51, 480852), 'svr_ip': '10.253.208.65', 'svr_port': 2882, 'id': 1, 'zone': 'zone1', 'inner_port': 2881, 'with_rootserver': 1, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 1676963029483249, 'first_sessid': 0, 'with_partition': 1}, {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 100518), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 3, 50, 955999), 'svr_ip': '10.253.208.67', 'svr_port': 2882, 'id': 2, 'zone': 'zone2', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 1676963029955435, 'first_sessid': 0, 'with_partition': 1}] [2023-02-21 15:13:14.504] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Observer restart [2023-02-21 15:13:14.505] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:14.505] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:13:14.507] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:13:14.507] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:14.533] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:14.533] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ps uax | egrep " 141345 " | grep -v grep [2023-02-21 15:13:14.637] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:14.637] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) observer[pid:141345] stopping ... [2023-02-21 15:13:14.637] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: kill -9 141345 [2023-02-21 15:13:14.704] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:14.704] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:14.729] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:14.729] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ps uax | egrep " 47234 " | grep -v grep [2023-02-21 15:13:14.840] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:14.840] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) observer[pid:47234] stopping ... [2023-02-21 15:13:14.840] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: kill -9 47234 [2023-02-21 15:13:14.936] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:14.937] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:14.960] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:14.960] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ps uax | egrep " 238886 " | grep -v grep [2023-02-21 15:13:15.055] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:15.055] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) observer[pid:238886] stopping ... [2023-02-21 15:13:15.055] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: kill -9 238886 [2023-02-21 15:13:15.128] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.129] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) check whether the port is released [2023-02-21 15:13:16.130] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:16.162] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.163] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:16.234] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.234] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 15:13:16.300] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.300] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) observer is stopped [2023-02-21 15:13:16.301] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) check whether the port is released [2023-02-21 15:13:16.301] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:16.324] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.324] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:16.387] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.388] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 15:13:16.447] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.447] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) observer is stopped [2023-02-21 15:13:16.447] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) check whether the port is released [2023-02-21 15:13:16.447] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:16.473] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.473] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:16.539] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.539] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 15:13:16.599] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) observer is stopped [2023-02-21 15:13:16.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:13:16.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:13:16.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:16.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:13:16.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:13:16.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:16.627] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:13:16.627] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 15:13:16.627] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:13:16.627] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) start command construction [2023-02-21 15:13:16.627] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 15:13:16.689] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.690] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:16.710] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:13:16.710] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 15:13:16.710] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:13:16.711] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) start command construction [2023-02-21 15:13:16.711] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 15:13:16.771] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.771] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:16.793] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:13:16.793] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 15:13:16.793] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:13:16.794] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) start command construction [2023-02-21 15:13:16.794] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 15:13:16.857] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:16.858] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- starting server1(10.253.208.65) observer [2023-02-21 15:13:16.858] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 15:13:16.858] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 15:13:17.040] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:17.041] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 delete env LD_LIBRARY_PATH [2023-02-21 15:13:17.041] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- starting server2(10.253.208.67) observer [2023-02-21 15:13:17.041] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 15:13:17.041] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 15:13:17.200] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:17.201] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 delete env LD_LIBRARY_PATH [2023-02-21 15:13:17.201] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- starting server3(10.253.208.172) observer [2023-02-21 15:13:17.201] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 15:13:17.201] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 15:13:18.227] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:18.227] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 delete env LD_LIBRARY_PATH [2023-02-21 15:13:21.230] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) program health check [2023-02-21 15:13:21.231] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:21.255] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:21.256] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ls /proc/143484 [2023-02-21 15:13:21.319] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:21.319] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) observer[pid: 143484] started [2023-02-21 15:13:21.319] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) program health check [2023-02-21 15:13:21.320] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:21.354] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:21.355] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ls /proc/49303 [2023-02-21 15:13:21.440] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:21.440] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) observer[pid: 49303] started [2023-02-21 15:13:21.440] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) program health check [2023-02-21 15:13:21.441] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:13:21.483] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:21.484] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ls /proc/241247 [2023-02-21 15:13:21.563] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:21.564] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) observer[pid: 241247] started [2023-02-21 15:13:21.564] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:13:21.564] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:13:21.564] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: select version(). args: None [2023-02-21 15:13:21.564] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: select version() [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 59, in connect [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if self.cursor is None or self.execute_sql('select version()', error=False) is False: [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:13:21.567] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 692, in _read_packet [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] packet_header = self._read_bytes(4) [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 749, in _read_bytes [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] CR.CR_SERVER_LOST, "Lost connection to MySQL server during query" [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query') [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:13:21.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 15:13:21.571] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:13:21.571] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:13:21.573] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:13:21.573] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:13:21.573] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:13:21.573] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:13:21.574] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:13:21.575] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:13:21.575] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:13:21.575] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:13:21.575] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] [2023-02-21 15:13:23.577] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:13:23.577] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:13:23.579] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:13:23.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:13:23.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:13:23.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:13:23.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:13:23.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:13:23.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:13:23.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:13:23.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:13:23.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:13:23.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:13:23.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] [2023-02-21 15:13:25.583] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:13:25.583] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:13:25.585] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:13:25.585] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:13:25.585] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:13:25.585] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:13:25.585] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:13:25.585] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:13:25.585] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:13:25.585] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:13:25.585] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:13:25.586] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:13:25.587] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] [2023-02-21 15:13:27.588] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:13:27.588] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:13:27.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:13:27.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] [2023-02-21 15:13:29.593] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:13:29.594] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:13:29.596] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:13:29.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:13:29.598] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:13:29.598] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:13:29.598] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:13:29.598] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] [2023-02-21 15:13:31.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:13:31.600] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:13:31.602] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:13:31.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] [2023-02-21 15:13:33.605] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:13:33.606] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:13:33.608] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:13:33.609] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] [2023-02-21 15:13:35.611] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:13:35.611] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:13:35.613] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:13:35.613] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:13:35.613] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:13:35.613] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:13:35.613] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:13:35.614] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:13:35.615] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:13:35.615] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:13:35.615] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:13:35.615] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:13:35.615] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:13:35.615] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [ERROR] [2023-02-21 15:13:37.617] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:13:37.617] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:13:37.622] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: set session ob_query_timeout=1000000000. args: None [2023-02-21 15:13:37.622] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2023-02-21 15:13:37.623] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- server check [2023-02-21 15:13:37.623] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0. args: None [2023-02-21 15:13:37.623] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0 [2023-02-21 15:13:37.626] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 101577), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 13, 36, 792635), 'svr_ip': '10.253.208.172', 'svr_port': 2882, 'id': 3, 'zone': 'zone3', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 0, 'first_sessid': 0, 'with_partition': 1} [2023-02-21 15:13:40.630] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0. args: None [2023-02-21 15:13:40.630] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0 [2023-02-21 15:13:40.632] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 101577), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 13, 36, 792635), 'svr_ip': '10.253.208.172', 'svr_port': 2882, 'id': 3, 'zone': 'zone3', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 0, 'first_sessid': 0, 'with_partition': 1} [2023-02-21 15:13:43.635] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0. args: None [2023-02-21 15:13:43.635] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0 [2023-02-21 15:13:43.706] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- query: select version(). args: None [2023-02-21 15:13:43.709] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- execute sql: select version() [2023-02-21 15:13:43.711] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- {'version()': '5.7.25-OceanBase_CE-v4.0.0.0'} [2023-02-21 15:13:43.711] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:13:43.712] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:13:43.713] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Wait for observer init [2023-02-21 15:13:43.718] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 15:13:43.718] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | observer | [2023-02-21 15:13:43.718] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:13:43.718] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 15:13:43.718] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:13:43.718] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 15:13:43.718] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 15:13:43.718] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 15:13:43.718] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:13:43.719] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 15:13:43.844] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 15:13:43.844] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | observer | [2023-02-21 15:13:43.844] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:13:43.844] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 15:13:43.844] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:13:43.844] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 15:13:43.844] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 15:13:43.844] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 15:13:43.844] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:13:43.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 15:13:43.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] [2023-02-21 15:13:43.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:13:43.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:13:43.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:13:43.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:13:43.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_restart-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:43.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:13:43.847] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:13:43.847] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:43.847] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:13:43.848] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:13:43.849] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Stop obproxy [2023-02-21 15:13:43.849] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:43.873] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:43.874] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/36638 [2023-02-21 15:13:43.935] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:43.935] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/36638/fd [2023-02-21 15:13:43.997] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:43.997] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 obproxy[pid:36638] stopping ... [2023-02-21 15:13:43.997] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid | xargs kill -9; kill -9 -36638 [2023-02-21 15:13:44.062] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:45.063] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 check whether the port is released [2023-02-21 15:13:45.064] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:45.087] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:45.088] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:45.150] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:45.151] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: rm -f /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:45.210] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:45.210] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 obproxy is stopped [2023-02-21 15:13:45.284] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:13:45.284] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:13:45.284] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:45.284] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:13:45.287] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:13:45.289] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Start obproxy [2023-02-21 15:13:45.290] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/obproxy/etc/obproxy_config.bin [2023-02-21 15:13:45.310] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:45.311] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 port check [2023-02-21 15:13:45.311] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:45.370] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:13:45.370] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 15:13:45.370] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:13:45.370] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- starting 10.253.208.63 obproxy [2023-02-21 15:13:45.371] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/obproxy/lib:' [2023-02-21 15:13:45.371] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/obproxy; /data/obdata/obproxy/bin/obproxy --listen_port 2883 [2023-02-21 15:13:45.571] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:45.571] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 delete env LD_LIBRARY_PATH [2023-02-21 15:13:45.571] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/obproxy/bin/obproxy --listen_port 2883$' | grep -v grep | awk '{print $2}' > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:45.674] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:45.682] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] obproxy program health check [2023-02-21 15:13:45.683] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:13:45.684] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:45.735] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:45.736] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:45.799] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:45.799] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 19 [2023-02-21 15:13:46.800] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:13:46.800] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:46.825] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:46.825] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:46.888] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:46.888] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 18 [2023-02-21 15:13:47.890] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:13:47.890] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:47.912] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:47.913] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:47.975] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:47.976] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 2104659487 [2023-02-21 15:13:47.976] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:13:47.976] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/41015/fd/ |grep -E 'socket:\[(2104659487)\]' [2023-02-21 15:13:48.039] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:48.039] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 15:13:48.101] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 2, error output: [2023-02-21 15:13:48.101] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/36614: 没有那个文件或目录 [2023-02-21 15:13:48.101] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:13:48.102] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: echo 41015 > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:48.164] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:48.246] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:13:48.246] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/obproxy && rm -fr /data/obdata/obproxy/obproxyd.sh [2023-02-21 15:13:48.268] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:48.268] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /home/admin/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /data/obdata/obproxy/obproxyd.sh [2023-02-21 15:13:48.313] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/obproxy/obproxyd.sh [2023-02-21 15:13:48.332] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:48.333] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash /data/obdata/obproxy/obproxyd.sh /data/obdata/obproxy 10.253.208.63 2883 [2023-02-21 15:13:48.397] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:49.399] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:13:49.399] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:49.422] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:49.423] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:49.491] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:49.491] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 16 [2023-02-21 15:13:50.492] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:13:50.492] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:50.515] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:50.516] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:50.579] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:50.580] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 15 [2023-02-21 15:13:51.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:13:51.581] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:13:51.604] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:51.604] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:51.668] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:51.669] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 2104659651 [2023-02-21 15:13:51.669] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:13:51.669] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/41269/fd/ |grep -E 'socket:\[(2104659651)\]' [2023-02-21 15:13:51.730] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:51.731] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 15:13:51.794] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:51.794] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 obproxy[pid: 41269] started [2023-02-21 15:13:51.813] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:13:51.813] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:13:51.813] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:51.813] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Connect to obproxy [2023-02-21 15:13:51.814] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:13:51.815] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:13:51.815] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- connect 10.253.208.63 -P2883 -uroot@proxysys -p [2023-02-21 15:13:51.817] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:13:51.818] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:13:51.945] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:13:51.945] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:13:51.946] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:13:51.957] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +-------------------------------------------------+ [2023-02-21 15:13:51.957] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | obproxy | [2023-02-21 15:13:51.957] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:13:51.957] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | ip | port | prometheus_port | status | [2023-02-21 15:13:51.957] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:13:51.957] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | 10.253.208.63 | 2883 | 2884 | active | [2023-02-21 15:13:51.957] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:13:51.957] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] obclient -h10.253.208.63 -P2883 -uroot -Doceanbase -A [2023-02-21 15:13:51.958] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:13:51.958] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:13:51.958] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:13:51.958] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:13:51.958] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Call obagent-py_script_restart-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:51.958] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:13:51.959] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:13:51.960] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call obagent-py_script_stop-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:51.960] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:13:51.961] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:13:51.961] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Stop obagent [2023-02-21 15:13:51.962] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:13:51.986] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:51.986] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ls /proc/142282 [2023-02-21 15:13:52.048] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:52.048] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) obagent[pid:142282] stopping ... [2023-02-21 15:13:52.048] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: kill -9 142282 [2023-02-21 15:13:52.107] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:52.107] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:13:52.131] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:52.132] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ls /proc/48166 [2023-02-21 15:13:52.194] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:52.195] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) obagent[pid:48166] stopping ... [2023-02-21 15:13:52.195] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: kill -9 48166 [2023-02-21 15:13:52.283] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:52.284] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:13:52.362] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:52.363] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ls /proc/239923 [2023-02-21 15:13:52.426] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:52.427] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) obagent[pid:239923] stopping ... [2023-02-21 15:13:52.427] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: kill -9 239923 [2023-02-21 15:13:52.492] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:53.494] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) check whether the port is released [2023-02-21 15:13:53.494] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:53.523] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:53.524] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:53.592] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:53.592] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:13:53.652] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:53.653] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) obagent is stopped [2023-02-21 15:13:53.653] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) check whether the port is released [2023-02-21 15:13:53.653] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:53.682] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:53.682] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:53.753] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:53.753] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:13:53.814] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:53.814] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) obagent is stopped [2023-02-21 15:13:53.814] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) check whether the port is released [2023-02-21 15:13:53.814] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:53.851] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:53.852] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:53.925] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:53.926] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:13:53.993] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:53.994] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) obagent is stopped [2023-02-21 15:13:54.048] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:13:54.048] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:13:54.048] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:13:54.048] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:13:54.167] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:13:54.169] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Start obagent [2023-02-21 15:13:54.234] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:13:54.258] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:13:54.258] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 15:13:54.258] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:13:54.259] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:54.344] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:13:54.344] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:54.370] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:54.370] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp64l6ft96.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:54.415] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:54.436] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:54.439] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:54.440] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:54.499] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:54.499] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp0xpqgpi8.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:54.544] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:54.568] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:54.572] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:54.572] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:54.631] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:54.632] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpwazmi3tu.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:54.676] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:54.699] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:54.702] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 15:13:54.702] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:13:54.762] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:54.762] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpcwxrvyjb.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:13:54.806] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:13:54.829] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:54.831] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:54.832] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:54.893] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:54.894] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp8kjj42t6.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:54.938] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:54.961] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:54.964] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:54.964] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:55.030] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:55.030] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmptypwxxa3.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:55.076] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:55.098] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:55.101] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:55.102] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:55.163] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:55.163] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpbks_u1ut.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:55.214] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:55.237] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:55.243] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:55.244] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:55.301] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:55.301] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpe0xch6bi.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:55.347] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:55.370] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:55.374] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:55.374] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:55.435] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:55.435] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpxuksbxt6.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:55.481] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:55.506] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:55.513] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:13:55.572] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:55.572] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpzmu_rr3k.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:13:55.618] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:13:55.642] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:55.646] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:13:55.707] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:55.708] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:13:55.729] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:13:55.729] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 15:13:55.729] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:13:55.730] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:55.811] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:13:55.811] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:55.833] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:55.834] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpe_jpdmzw.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:55.884] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:55.939] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:55.943] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:55.944] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:56.011] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:56.012] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp6t1082qa.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:56.062] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:56.086] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:56.089] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:56.089] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:56.151] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:56.151] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpbgfo7lnw.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:56.201] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:56.223] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:56.226] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 15:13:56.227] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:13:56.287] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:56.287] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpoedvp774.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:13:56.334] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:13:56.356] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:56.358] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:56.358] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:56.421] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:56.422] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmphh_jzyit.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:56.469] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:56.490] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:56.493] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:56.493] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:56.554] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:56.554] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp197zthxj.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:56.603] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:56.626] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:56.630] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:56.631] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:56.687] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:56.688] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpkpke5nkh.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:56.742] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:56.763] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:56.768] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:56.769] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:56.829] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:56.829] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpvsc_zgkr.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:56.878] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:56.903] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:56.906] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:56.907] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:56.968] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:56.968] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpiw6d6i2n.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:57.013] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:57.040] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:57.044] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:13:57.107] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:57.108] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpcxrpgvvr.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:13:57.155] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:13:57.178] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:57.181] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:13:57.247] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:57.248] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:13:57.272] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:13:57.272] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 15:13:57.272] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:13:57.273] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:57.363] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:13:57.363] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:57.387] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:57.388] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp5jrt28ga.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:57.433] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:13:57.458] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:57.462] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:57.463] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:57.523] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:57.524] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpptt3492t.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:57.570] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:13:57.595] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:57.598] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:57.599] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:57.662] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:57.662] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp2atvzb9n.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:57.707] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:13:57.732] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:57.734] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 15:13:57.735] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:13:57.798] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:57.798] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpg0tmwaxu.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:13:57.841] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:13:57.867] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:57.869] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:57.870] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:57.935] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:57.935] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp03v_zf7x.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:57.981] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:13:58.019] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:58.022] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:58.022] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:58.085] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:58.085] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp89de009b.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:58.130] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:13:58.156] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:58.160] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:58.161] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:58.222] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:58.222] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpc143j8hu.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:58.270] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:13:58.294] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:58.299] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:58.300] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:58.356] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:58.357] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp41scoyo7.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:58.401] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:13:58.424] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:58.428] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:58.428] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:58.488] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:58.489] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpvt06_6b_.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:58.533] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:13:58.555] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:58.562] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:13:58.682] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:58.682] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpofzb8zw8.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:13:58.728] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:13:58.753] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:13:58.756] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:13:58.817] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:58.886] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] obagent program health check [2023-02-21 15:13:59.892] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) program health check [2023-02-21 15:13:59.892] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:13:59.916] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:59.917] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:13:59.985] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:13:59.985] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) program health check [2023-02-21 15:13:59.986] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:14:00.010] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:00.010] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:00.086] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:00.086] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) program health check [2023-02-21 15:14:00.086] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:14:00.113] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:00.113] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:00.190] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:00.191] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- start to sync target config [2023-02-21 15:14:00.194] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:14:00.194] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:14:00.195] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:14:00.195] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:14:00.196] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.65:8088/metrics/stat" [2023-02-21 15:14:00.235] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:00.236] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.67:8088/metrics/stat" [2023-02-21 15:14:00.282] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:00.283] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.172:8088/metrics/stat" [2023-02-21 15:14:00.322] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:00.324] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +----------------------------------------------------+ [2023-02-21 15:14:00.324] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | obagent | [2023-02-21 15:14:00.324] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:14:00.324] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | ip | server_port | pprof_port | status | [2023-02-21 15:14:00.324] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:14:00.325] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | 10.253.208.65 | 8088 | 8089 | active | [2023-02-21 15:14:00.325] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | 10.253.208.67 | 8088 | 8089 | active | [2023-02-21 15:14:00.325] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | 10.253.208.172 | 8088 | 8089 | active | [2023-02-21 15:14:00.325] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:14:00.325] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:14:00.325] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:14:00.325] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:14:00.325] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:14:00.325] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_restart-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:14:00.325] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:14:00.327] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:14:00.327] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_stop-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:14:00.327] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:14:00.328] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:14:00.329] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Stop prometheus [2023-02-21 15:14:00.329] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:14:00.350] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:00.351] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/37177 [2023-02-21 15:14:00.412] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:00.412] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/37177/fd [2023-02-21 15:14:00.473] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:00.474] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 prometheus[pid:37177] stopping... [2023-02-21 15:14:00.474] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheusd.pid | xargs kill -9; kill -9 37177 [2023-02-21 15:14:00.546] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:01.548] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 check whether the port is released [2023-02-21 15:14:01.548] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:01.575] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:01.575] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: rm -f /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:14:01.637] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:01.637] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 prometheus is stopped [2023-02-21 15:14:01.764] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:14:01.764] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:14:01.764] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:14:01.764] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:14:01.767] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:14:01.768] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Start promethues [2023-02-21 15:14:01.769] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/prometheus/.prometheus_started [2023-02-21 15:14:01.793] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:01.794] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:14:01.856] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:01.857] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:14:01.919] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:01.970] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- write global: [2023-02-21 15:14:01.970] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] scrape_interval: 1s [2023-02-21 15:14:01.970] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] evaluation_interval: 10s [2023-02-21 15:14:01.970] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:01.970] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] rule_files: [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - rules/*rules.yaml [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] scrape_configs: [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - job_name: prometheus [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] metrics_path: /metrics [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.63:9090 [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - job_name: node [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] metrics_path: /metrics/node/host [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:14:01.971] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - job_name: ob_basic [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/basic [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:14:01.972] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - job_name: ob_extra [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/extra [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - job_name: agent [2023-02-21 15:14:01.973] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] metrics_path: /metrics/stat [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:14:01.974] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - targets/*.yaml to admin@10.253.208.63:22: /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:14:01.975] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:14:02.000] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:02.001] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpjwk1ri81 to /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:14:02.045] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:14:02.067] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:14:02.068] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:14:02.130] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:02.131] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:14:02.175] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:14:02.197] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:14:02.197] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle --start-only [2023-02-21 15:14:02.299] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:02.300] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheus.pid` && ls /proc/$pid [2023-02-21 15:14:02.365] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:03.423] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] prometheus program health check [2023-02-21 15:14:03.424] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:03.424] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:14:03.447] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:03.555] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:14:03.555] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:14:03.556] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:14:03.556] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Connect to prometheus [2023-02-21 15:14:03.557] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:14:03.559] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:14:03.559] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- connect prometheus (10.253.208.63:9090 by user None) [2023-02-21 15:14:03.559] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 15:14:03.565] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:14:03.565] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:14:03.687] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:14:03.687] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:14:03.689] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:14:03.689] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +------------------------------------------------------+ [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | prometheus | [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] | http://10.253.208.63:9090 | | | active | [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - Call grafana-py_script_restart-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:14:03.697] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:14:03.699] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:14:03.699] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call grafana-py_script_stop-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:14:03.699] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:14:03.700] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:14:03.701] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Stop grafana [2023-02-21 15:14:03.702] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:14:03.728] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:03.728] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/37451 [2023-02-21 15:14:03.799] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:03.799] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/37451/fd [2023-02-21 15:14:03.879] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:03.880] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 grafana[pid:37451] stopping... [2023-02-21 15:14:03.880] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: kill -9 37451 [2023-02-21 15:14:03.942] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:04.943] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 check whether the port is released [2023-02-21 15:14:04.943] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:04.969] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:04.969] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 grafana is stopped [2023-02-21 15:14:05.008] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:14:05.008] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:14:05.008] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] -- Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:14:05.009] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:14:05.011] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:14:05.012] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] Start grafana [2023-02-21 15:14:05.013] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 generate obd-grafana ini file [2023-02-21 15:14:05.014] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf && rm -fr /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:14:05.035] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:05.036] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpqb2giu0i.ini to /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:14:05.080] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:14:05.103] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:14:05.104] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 generate datasources yaml [2023-02-21 15:14:05.106] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- write apiVersion: 1 [2023-02-21 15:14:05.106] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] datasources: [2023-02-21 15:14:05.106] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - name: OB-Prometheus [2023-02-21 15:14:05.106] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] isDefault: 'true' [2023-02-21 15:14:05.106] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] type: prometheus [2023-02-21 15:14:05.107] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] access: proxy [2023-02-21 15:14:05.107] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] editable: 'true' [2023-02-21 15:14:05.107] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] url: http://10.253.208.63:9090 to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:14:05.107] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/datasources && rm -fr /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:14:05.165] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:05.165] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpjeeqx1ly to /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:14:05.210] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:14:05.231] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:14:05.233] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 generate providers yaml [2023-02-21 15:14:05.236] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- write apiVersion: 1 [2023-02-21 15:14:05.236] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] providers: [2023-02-21 15:14:05.236] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - name: OceanBase Metrics [2023-02-21 15:14:05.236] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] type: file [2023-02-21 15:14:05.236] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] allowUiUpdates: 'true' [2023-02-21 15:14:05.236] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] options: [2023-02-21 15:14:05.236] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] path: /data/obdata/grafana/conf/provisioning/dashboards/templates to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:14:05.237] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:14:05.294] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:05.294] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpmr6gr9od to /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:14:05.340] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:14:05.362] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:14:05.366] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 15:14:05.447] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:05.448] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/grafana; bash -c '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid > /data/obdata/grafana/data/log/grafana-console.log 2>&1 &' [2023-02-21 15:14:05.517] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:05.517] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 15:14:05.597] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:06.667] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] grafana program health check [2023-02-21 15:14:06.667] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:06.667] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:06.668] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:06.693] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:06.694] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:06.754] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:06.754] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:06.755] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:06.755] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 19 [2023-02-21 15:14:07.756] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:07.756] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:07.756] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:07.782] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:07.783] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:07.844] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:07.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:07.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:07.845] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 18 [2023-02-21 15:14:08.846] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:08.847] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:08.847] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:08.873] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:08.874] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:08.936] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:08.937] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:08.937] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:08.937] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 17 [2023-02-21 15:14:09.939] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:09.939] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:09.939] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:09.966] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:09.967] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:10.028] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:10.028] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:10.028] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:10.029] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 16 [2023-02-21 15:14:11.029] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:11.029] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:11.030] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:11.057] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:11.058] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:11.119] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:11.120] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:11.120] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:11.120] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 15 [2023-02-21 15:14:12.122] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:12.122] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:12.122] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:12.150] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:12.151] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:12.215] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:12.215] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:12.215] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:12.215] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 14 [2023-02-21 15:14:13.217] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:13.217] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:13.217] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:13.245] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:13.246] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:13.307] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:13.307] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:13.307] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:13.307] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 13 [2023-02-21 15:14:14.309] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:14.309] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:14.309] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:14.337] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:14.338] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:14.401] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:14.402] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:14.402] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:14.402] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 12 [2023-02-21 15:14:15.403] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:15.404] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:15.404] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:15.433] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:15.433] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:15.496] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:15.496] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:15.496] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:15.496] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 11 [2023-02-21 15:14:16.498] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:16.498] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:16.498] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:16.526] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:16.527] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:16.588] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:16.589] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:16.589] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:16.589] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 10 [2023-02-21 15:14:17.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:17.590] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:17.591] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:17.618] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:17.618] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:17.680] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:17.680] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:17.680] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:17.681] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 9 [2023-02-21 15:14:18.681] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:18.681] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:18.681] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:18.707] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:18.707] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:18.767] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:18.768] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:18.768] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:18.768] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 8 [2023-02-21 15:14:19.769] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:19.769] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:19.770] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:19.797] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:19.798] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:19.860] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:19.860] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:19.861] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:19.861] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 7 [2023-02-21 15:14:20.862] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:20.863] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:20.863] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:20.888] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:20.889] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:20.949] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:20.949] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:20.949] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:20.949] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 6 [2023-02-21 15:14:21.951] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:21.951] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:21.951] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:21.979] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:21.979] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:22.039] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:22.040] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:22.040] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:22.040] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 5 [2023-02-21 15:14:23.041] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:23.042] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:23.042] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:23.069] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:23.070] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:23.133] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:23.133] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:23.133] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:23.134] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 4 [2023-02-21 15:14:24.135] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:24.135] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:24.135] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:24.163] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:24.164] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:24.226] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:24.226] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:24.226] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:24.226] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 3 [2023-02-21 15:14:25.228] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:25.228] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:25.228] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:25.255] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:25.255] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:25.315] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:25.315] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:25.315] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:25.316] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 2 [2023-02-21 15:14:26.317] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:26.317] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:26.318] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:26.347] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:26.348] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:26.409] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:26.409] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:26.409] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:26.409] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 1 [2023-02-21 15:14:27.411] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:14:27.411] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f2827b55860>: ['']} [2023-02-21 15:14:27.411] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:14:27.437] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:14:27.438] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104661088)\]' [2023-02-21 15:14:27.498] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:14:27.498] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:14:27.498] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] [2023-02-21 15:14:27.499] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 grafana, remaining retries: 0 [2023-02-21 15:14:27.528] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [WARNING] [WARN] failed to start 10.253.208.63 grafana [2023-02-21 15:14:27.528] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:14:27.528] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:14:27.528] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:14:27.528] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:14:27.528] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 15:14:27.529] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 15:14:27.529] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 15:14:27.529] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 15:14:27.529] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 15:14:27.529] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 15:14:27.529] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 15:14:27.529] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 15:14:27.529] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 15:14:27.529] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 15:14:27.529] [32d5f0e0-b1b7-11ed-896f-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 15:23:12.698] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 15:23:12.699] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 15:23:12.699] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 15:23:12.699] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 15:23:12.699] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'with_parameter': None} [2023-02-21 15:23:12.699] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 15:23:12.699] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 15:23:12.700] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 15:23:12.700] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 15:23:12.700] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 15:23:12.711] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [INFO] Get local repositories and plugins [2023-02-21 15:23:12.759] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 15:23:12.759] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:12.759] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 15:23:12.759] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 15:23:12.762] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:12.762] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 15:23:12.764] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:12.765] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 15:23:12.767] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:12.768] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 15:23:12.770] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:12.770] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 15:23:12.772] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching restart plugin for components ... [2023-02-21 15:23:12.773] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching restart plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:12.773] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 15:23:12.774] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_restart-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:23:12.774] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching restart plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:12.774] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_restart-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:23:12.775] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching restart plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:12.775] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_restart-0.1 for obagent-1.2.0 [2023-02-21 15:23:12.775] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching restart plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:12.775] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_restart-2.37.1 for prometheus-2.37.1 [2023-02-21 15:23:12.775] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching restart plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:12.775] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_restart-7.5.17 for grafana-7.5.17 [2023-02-21 15:23:12.775] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching reload plugin for components ... [2023-02-21 15:23:12.775] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching reload plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:12.776] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_reload-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:23:12.776] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching reload plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:12.776] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_reload-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:23:12.776] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching reload plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:12.776] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_reload-0.1 for obagent-1.2.0 [2023-02-21 15:23:12.777] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching reload plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:12.777] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_reload-2.37.1 for prometheus-2.37.1 [2023-02-21 15:23:12.777] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching reload plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:12.777] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_reload-7.5.17 for grafana-7.5.17 [2023-02-21 15:23:12.777] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 15:23:12.777] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:12.778] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:23:12.778] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:12.778] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:23:12.778] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:12.778] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 15:23:12.778] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:12.779] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 15:23:12.779] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:12.779] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 15:23:12.779] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching stop plugin for components ... [2023-02-21 15:23:12.779] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:12.779] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:23:12.779] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:12.780] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:23:12.780] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching stop plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:12.780] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_stop-0.1 for obagent-1.2.0 [2023-02-21 15:23:12.780] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching stop plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:12.780] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_stop-2.37.1 for prometheus-2.37.1 [2023-02-21 15:23:12.780] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching stop plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:12.780] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_stop-7.5.17 for grafana-7.5.17 [2023-02-21 15:23:12.780] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 15:23:12.781] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:12.781] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:23:12.781] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:12.781] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:23:12.781] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:12.782] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 15:23:12.782] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:12.782] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 15:23:12.782] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:12.782] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 15:23:12.782] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 15:23:12.782] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:12.783] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:23:12.783] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:12.783] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:23:12.783] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:12.783] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 15:23:12.783] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:12.783] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 15:23:12.784] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:12.784] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 15:23:12.784] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 15:23:12.784] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:12.784] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:23:12.784] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:12.785] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:23:12.785] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:12.785] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 15:23:12.785] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:12.785] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 15:23:12.785] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:12.785] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 15:23:12.857] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 15:23:12.858] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 15:23:12.858] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 15:23:12.858] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:23:12.858] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:13.569] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 15:23:13.570] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:23:13.570] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:13.739] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 15:23:13.739] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 15:23:13.739] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:13.838] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 15:23:13.838] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 15:23:13.838] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:13.861] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 15:23:13.861] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 15:23:13.861] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:14.023] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 15:23:15.199] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [INFO] Cluster status check [2023-02-21 15:23:15.199] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching status plugin for components ... [2023-02-21 15:23:15.200] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching status plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:15.202] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:23:15.202] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching status plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:15.202] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:23:15.202] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching status plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:15.203] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_status-0.1 for obagent-1.2.0 [2023-02-21 15:23:15.203] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching status plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:15.203] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_status-2.37.1 for prometheus-2.37.1 [2023-02-21 15:23:15.203] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Searching status plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:15.203] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_status-7.5.17 for grafana-7.5.17 [2023-02-21 15:23:15.204] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:23:15.204] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:23:15.205] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:23:15.205] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:23:15.314] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.315] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/143484 [2023-02-21 15:23:15.377] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.378] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:23:15.413] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.414] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/49303 [2023-02-21 15:23:15.474] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.475] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:23:15.502] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.503] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/241247 [2023-02-21 15:23:15.583] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.583] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:23:15.584] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:23:15.584] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:23:15.584] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:23:15.585] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:23:15.586] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:23:15.613] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.613] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/41269 [2023-02-21 15:23:15.674] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.675] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:23:15.675] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:23:15.675] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Call obagent-py_script_status-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:23:15.675] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:23:15.676] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:23:15.676] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:23:15.701] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.701] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/144427 [2023-02-21 15:23:15.764] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.765] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:23:15.801] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.802] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/50237 [2023-02-21 15:23:15.888] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.889] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:23:15.955] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:15.956] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/242293 [2023-02-21 15:23:16.042] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:16.042] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:23:16.042] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:23:16.042] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_status-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:23:16.042] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:23:16.043] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:23:16.044] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:23:16.064] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:16.065] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:23:16.065] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:23:16.065] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Call grafana-py_script_status-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:23:16.065] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:23:16.066] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:23:16.066] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:23:16.124] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:16.125] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/41864 [2023-02-21 15:23:16.186] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:23:16.187] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:23:16.187] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:23:16.187] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - Deploy status inconsistent [2023-02-21 15:23:16.243] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [ERROR] [ERROR] OBD-1005: Some of the servers in the cluster have been stopped [2023-02-21 15:23:16.243] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [INFO] 10.253.208.63 prometheus is stopped [2023-02-21 15:23:16.243] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 15:23:16.243] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 15:23:16.243] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 15:23:16.244] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 15:23:16.244] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 15:23:16.244] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 15:23:16.244] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 15:23:16.244] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 15:23:16.244] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 15:23:16.244] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 15:23:16.244] [9992994a-b1b8-11ed-a148-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 15:24:04.005] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 15:24:04.006] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 15:24:04.007] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 15:24:04.007] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 15:24:04.007] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'force_delete': None, 'strict_check': None, 'without_parameter': None} [2023-02-21 15:24:04.007] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 15:24:04.007] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 15:24:04.007] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 15:24:04.008] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 15:24:04.008] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 15:24:04.025] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Deploy status judge [2023-02-21 15:24:04.026] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Get local repositories [2023-02-21 15:24:04.027] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 15:24:04.027] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:04.027] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Search repository oceanbase-ce version: 4.0.0.0, tag: 1d56dc742f5f05a2d15797d291b51a94019e728d, release: None, package_hash: None [2023-02-21 15:24:04.028] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 15:24:04.028] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 15:24:04.028] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/oceanbase-ce [2023-02-21 15:24:04.032] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found repository oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:04.032] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:04.032] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Search repository obproxy-ce version: 4.0.0, tag: de53232a951184fad75b15884458d85e31d2f6c3, release: None, package_hash: None [2023-02-21 15:24:04.033] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 15:24:04.033] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obproxy-ce [2023-02-21 15:24:04.037] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found repository obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:04.037] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:04.037] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Search repository obagent version: 1.2.0, tag: 0e8f5ee68c337ea28514c9f3f820ea546227fa7e, release: None, package_hash: None [2023-02-21 15:24:04.037] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 15:24:04.037] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/obagent [2023-02-21 15:24:04.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found repository obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:04.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:04.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Search repository prometheus version: 2.37.1, tag: 58913c7606f05feb01bc1c6410346e5fc31cf263, release: None, package_hash: None [2023-02-21 15:24:04.042] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 15:24:04.042] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/prometheus [2023-02-21 15:24:04.045] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found repository prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:04.046] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:04.046] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Search repository grafana version: 7.5.17, tag: 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6, release: None, package_hash: None [2023-02-21 15:24:04.046] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 15:24:04.046] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository/grafana [2023-02-21 15:24:04.050] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found repository grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:04.157] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Get deploy config [2023-02-21 15:24:04.205] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Search plugins [2023-02-21 15:24:04.206] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start_check plugin for components ... [2023-02-21 15:24:04.207] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:04.207] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 15:24:04.208] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:04.208] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:04.208] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:04.208] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start_check plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:04.209] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start_check-1.1.1 for obagent-1.2.0 [2023-02-21 15:24:04.209] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start_check plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:04.209] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:04.209] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start_check plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:04.209] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start_check-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:04.209] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 15:24:04.209] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:04.210] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:04.210] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:04.210] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:04.210] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:04.210] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 15:24:04.211] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:04.211] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:04.211] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:04.211] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:04.211] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 15:24:04.211] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:04.212] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:04.212] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:04.212] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:04.212] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:04.212] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 15:24:04.212] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:04.212] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:04.212] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:04.213] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:04.213] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 15:24:04.213] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:04.214] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:04.214] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:04.214] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:04.214] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:04.214] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 15:24:04.214] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:04.214] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:04.214] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:04.215] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:04.215] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 15:24:04.215] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:04.215] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:04.215] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:04.216] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:04.216] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:04.216] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 15:24:04.216] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:04.216] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:04.216] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:04.216] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:04.338] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 15:24:05.643] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 15:24:05.644] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 15:24:05.644] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 15:24:05.645] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:05.645] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:06.898] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 15:24:06.898] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:06.898] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:07.202] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 15:24:07.203] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 15:24:07.203] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:07.385] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 15:24:07.386] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:07.386] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:07.426] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 15:24:07.427] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:07.427] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:07.557] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Cluster status check [2023-02-21 15:24:07.558] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching status plugin for components ... [2023-02-21 15:24:07.558] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching status plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:07.559] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:07.559] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching status plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:07.560] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:07.560] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching status plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:07.560] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_status-0.1 for obagent-1.2.0 [2023-02-21 15:24:07.560] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching status plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:07.561] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_status-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:07.561] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Searching status plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:07.561] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_status-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:07.561] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:07.561] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:24:07.562] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:24:07.563] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:07.597] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:07.597] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/143484 [2023-02-21 15:24:07.660] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:07.661] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:07.703] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:07.704] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/49303 [2023-02-21 15:24:07.764] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:07.765] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:07.820] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:07.821] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/241247 [2023-02-21 15:24:07.941] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:07.941] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:24:07.941] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:24:07.942] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:07.942] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:24:07.943] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:24:07.943] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:24:07.970] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:07.971] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/41269 [2023-02-21 15:24:08.033] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.034] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:24:08.034] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:24:08.034] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obagent-py_script_status-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:08.034] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:24:08.035] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:24:08.036] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:24:08.058] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.058] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/144427 [2023-02-21 15:24:08.118] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.119] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:24:08.147] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.148] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/50237 [2023-02-21 15:24:08.208] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.209] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:24:08.237] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.238] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/242293 [2023-02-21 15:24:08.361] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.362] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:24:08.362] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:24:08.362] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_status-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:08.362] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:24:08.363] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:24:08.364] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:24:08.385] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.385] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:24:08.385] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:24:08.386] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call grafana-py_script_status-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:08.386] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:24:08.386] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:24:08.387] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:24:08.459] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.459] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/41864 [2023-02-21 15:24:08.523] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.523] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:24:08.523] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:24:08.523] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Deploy status inconsistent [2023-02-21 15:24:08.601] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:08.602] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 15:24:08.607] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 15:24:08.608] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Check before start observer [2023-02-21 15:24:08.608] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:08.631] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.631] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/143484 [2023-02-21 15:24:08.694] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.695] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:08.721] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.721] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/49303 [2023-02-21 15:24:08.811] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.812] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:08.858] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.858] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/241247 [2023-02-21 15:24:08.955] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.956] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: date +%s%N [2023-02-21 15:24:08.979] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:08.980] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.65 time delta -1.8984375 [2023-02-21 15:24:08.980] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: date +%s%N [2023-02-21 15:24:09.000] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.001] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.67 time delta -2.103759765625 [2023-02-21 15:24:09.001] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: date +%s%N [2023-02-21 15:24:09.032] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.033] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.172 time delta -1.813720703125 [2023-02-21 15:24:09.131] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 15:24:09.131] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 15:24:09.131] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:09.131] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 15:24:09.133] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 15:24:09.133] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Check before start obproxy [2023-02-21 15:24:09.134] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:24:09.155] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.156] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/41269/fd [2023-02-21 15:24:09.216] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.265] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 15:24:09.265] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 15:24:09.265] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start_check-1.1.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:09.265] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 15:24:09.266] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 15:24:09.267] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Check before start obagent [2023-02-21 15:24:09.267] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:24:09.295] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.296] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/144427 [2023-02-21 15:24:09.357] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.357] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:24:09.376] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.377] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/50237 [2023-02-21 15:24:09.436] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.437] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:24:09.467] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.468] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/242293 [2023-02-21 15:24:09.546] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.659] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 15:24:09.659] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 15:24:09.659] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start_check-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:09.659] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 15:24:09.661] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 15:24:09.662] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Check before start prometheus [2023-02-21 15:24:09.663] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:24:09.684] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.684] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 15:24:09.684] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:09.747] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.794] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 15:24:09.794] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 15:24:09.794] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start_check-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:09.794] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import start_check [2023-02-21 15:24:09.795] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add start_check ref count to 1 [2023-02-21 15:24:09.796] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Check before start grafana [2023-02-21 15:24:09.796] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:24:09.819] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.819] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/41864 [2023-02-21 15:24:09.879] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.927] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub start_check ref count to 0 [2023-02-21 15:24:09.927] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export start_check [2023-02-21 15:24:09.928] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:09.928] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import start [2023-02-21 15:24:09.931] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 15:24:09.931] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Start observer [2023-02-21 15:24:09.932] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:09.955] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:09.956] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/143484 [2023-02-21 15:24:10.017] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:10.018] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:10.037] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:10.038] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/49303 [2023-02-21 15:24:10.095] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:10.096] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:10.146] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:10.147] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/241247 [2023-02-21 15:24:10.215] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:10.324] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] observer program health check [2023-02-21 15:24:13.328] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 15:24:13.328] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:13.352] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:13.352] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/143484 [2023-02-21 15:24:13.416] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:13.416] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) observer[pid: 143484] started [2023-02-21 15:24:13.416] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 15:24:13.416] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:13.437] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:13.438] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/49303 [2023-02-21 15:24:13.500] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:13.500] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) observer[pid: 49303] started [2023-02-21 15:24:13.500] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 15:24:13.501] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:13.539] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:13.539] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/241247 [2023-02-21 15:24:13.695] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:13.696] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) observer[pid: 241247] started [2023-02-21 15:24:13.714] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 15:24:13.714] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export start [2023-02-21 15:24:13.714] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:13.714] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 15:24:13.747] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 15:24:13.748] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Connect to observer [2023-02-21 15:24:13.748] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 15:24:13.879] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 15:24:13.879] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 15:24:13.880] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 15:24:13.880] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:13.880] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 15:24:13.882] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 15:24:13.882] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- execute sql: select column_value from oceanbase.__all_core_table where table_name = '__all_global_stat' and column_name = 'baseline_schema_version' [2023-02-21 15:24:13.887] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 15:24:13.887] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 15:24:14.011] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:14.011] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import start [2023-02-21 15:24:14.015] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 15:24:14.019] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Start obproxy [2023-02-21 15:24:14.020] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/obproxy/etc/obproxy_config.bin [2023-02-21 15:24:14.042] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:14.042] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 port check [2023-02-21 15:24:14.042] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:24:14.100] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:14.100] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/41269/ [2023-02-21 15:24:14.159] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:14.160] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:14.222] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:14.223] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 2104659651 [2023-02-21 15:24:14.223] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:14.223] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/41269/fd/ |grep -E 'socket:\[(2104659651)\]' [2023-02-21 15:24:14.286] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:14.412] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] obproxy program health check [2023-02-21 15:24:14.413] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:14.413] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:24:14.434] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:14.435] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:14.497] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:14.497] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 2104659651 [2023-02-21 15:24:14.497] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:14.497] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/41269/fd/ |grep -E 'socket:\[(2104659651)\]' [2023-02-21 15:24:14.559] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:14.559] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 15:24:14.620] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:14.620] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 obproxy[pid: 41269] started [2023-02-21 15:24:14.674] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 15:24:14.674] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export start [2023-02-21 15:24:14.674] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:14.674] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 15:24:14.676] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 15:24:14.676] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Connect to obproxy [2023-02-21 15:24:14.677] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- connect 10.253.208.63 -P2883 -uroot@proxysys -p [2023-02-21 15:24:14.808] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 15:24:14.808] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 15:24:14.808] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 15:24:14.809] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:14.809] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 15:24:14.809] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 15:24:14.810] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set observer_sys_password = [2023-02-21 15:24:14.830] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- execute sql: alter proxyconfig set obproxy_sys_password = [2023-02-21 15:24:14.849] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 15:24:14.849] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 15:24:14.939] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:14.940] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import start [2023-02-21 15:24:15.031] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 15:24:15.032] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Start obagent [2023-02-21 15:24:15.071] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:24:15.095] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:15.096] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/144427 [2023-02-21 15:24:15.162] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:15.162] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:24:15.184] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:15.185] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/50237 [2023-02-21 15:24:15.271] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:15.272] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:24:15.314] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:15.315] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/242293 [2023-02-21 15:24:15.381] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:15.425] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] obagent program health check [2023-02-21 15:24:16.426] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- server1(10.253.208.65) program health check [2023-02-21 15:24:16.427] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:24:16.464] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:16.464] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:16.535] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:16.535] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- server2(10.253.208.67) program health check [2023-02-21 15:24:16.535] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:24:16.560] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:16.561] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:16.632] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:16.632] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- server3(10.253.208.172) program health check [2023-02-21 15:24:16.632] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:24:16.698] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:16.698] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:16.807] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:16.807] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- start to sync target config [2023-02-21 15:24:16.859] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 15:24:16.860] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export start [2023-02-21 15:24:16.860] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obagent-py_script_connect-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:16.860] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 15:24:16.860] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 15:24:16.861] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 15:24:16.861] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 15:24:16.861] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:16.861] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import start [2023-02-21 15:24:16.864] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 15:24:16.864] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Start promethues [2023-02-21 15:24:16.865] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/.prometheus_started [2023-02-21 15:24:16.887] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:16.887] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:24:16.947] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:16.947] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:24:17.006] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:17.038] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- write global: [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] scrape_interval: 1s [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] evaluation_interval: 10s [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] rule_files: [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - rules/*rules.yaml [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] scrape_configs: [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - job_name: prometheus [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] metrics_path: /metrics [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.63:9090 [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - job_name: node [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] metrics_path: /metrics/node/host [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:24:17.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - job_name: ob_basic [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/basic [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - job_name: ob_extra [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/extra [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:24:17.040] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - job_name: agent [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] metrics_path: /metrics/stat [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:24:17.041] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - targets/*.yaml to admin@10.253.208.63:22: /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:24:17.088] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:24:17.088] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:24:17.110] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:17.110] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- send /tmp/tmp255up_ec to /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:24:17.156] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:24:17.176] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:24:17.180] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:24:17.242] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:17.243] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:24:17.288] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:24:17.311] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:24:17.312] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle --start-only [2023-02-21 15:24:17.436] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:17.436] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheus.pid` && ls /proc/$pid [2023-02-21 15:24:17.502] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:18.520] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] prometheus program health check [2023-02-21 15:24:18.520] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:18.521] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:24:18.543] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:18.543] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:18.611] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:18.611] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 2104622792 [2023-02-21 15:24:18.612] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:18.612] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/41641/fd/ |grep -E 'socket:\[(2104622792)\]' [2023-02-21 15:24:18.674] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:18.674] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 15:24:18.737] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 2, error output: [2023-02-21 15:24:18.737] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/37148: 没有那个文件或目录 [2023-02-21 15:24:18.737] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:18.738] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:24:18.798] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:18.799] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:24:18.844] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:24:18.867] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:24:18.867] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle [2023-02-21 15:24:18.944] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:19.945] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:19.946] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:24:19.968] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:19.968] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:20.043] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:20.044] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 prometheus, remaining retries: 18 [2023-02-21 15:24:21.045] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:21.046] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:24:21.075] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:21.076] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:21.161] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:21.162] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 2104670728 [2023-02-21 15:24:21.162] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:21.162] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc/45321/fd/ |grep -E 'socket:\[(2104670728)\]' [2023-02-21 15:24:21.227] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:21.227] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 15:24:21.296] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:21.296] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 prometheusd[pid: 45321] started [2023-02-21 15:24:21.395] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 15:24:21.395] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export start [2023-02-21 15:24:21.395] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:21.395] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import connect [2023-02-21 15:24:21.397] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add connect ref count to 1 [2023-02-21 15:24:21.397] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Connect to Prometheus [2023-02-21 15:24:21.398] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- connect prometheus (10.253.208.63:9090 by user None) [2023-02-21 15:24:21.398] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 15:24:21.529] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub connect ref count to 0 [2023-02-21 15:24:21.529] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export connect [2023-02-21 15:24:21.529] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Initialize cluster [2023-02-21 15:24:21.530] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:21.530] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import bootstrap [2023-02-21 15:24:21.530] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add bootstrap ref count to 1 [2023-02-21 15:24:21.531] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: touch /data/obdata/prometheus/.prometheus_started [2023-02-21 15:24:21.564] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:21.564] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub bootstrap ref count to 0 [2023-02-21 15:24:21.564] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export bootstrap [2023-02-21 15:24:21.661] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:21.662] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import start [2023-02-21 15:24:21.666] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add start ref count to 1 [2023-02-21 15:24:21.667] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Start grafana [2023-02-21 15:24:21.668] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate obd-grafana ini file [2023-02-21 15:24:21.671] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf && rm -fr /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:24:21.723] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:21.723] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- send /tmp/tmpo508ir9h.ini to /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:24:21.769] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:24:21.795] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:24:21.798] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate datasources yaml [2023-02-21 15:24:21.800] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 15:24:21.801] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] datasources: [2023-02-21 15:24:21.801] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - name: OB-Prometheus [2023-02-21 15:24:21.801] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] isDefault: 'true' [2023-02-21 15:24:21.801] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] type: prometheus [2023-02-21 15:24:21.801] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] access: proxy [2023-02-21 15:24:21.801] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] editable: 'true' [2023-02-21 15:24:21.801] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] url: http://10.253.208.63:9090 to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:24:21.802] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/datasources && rm -fr /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:24:21.862] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:21.863] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- send /tmp/tmplruuqm7x to /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:24:21.908] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:24:21.930] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:24:21.933] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 generate providers yaml [2023-02-21 15:24:21.935] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- write apiVersion: 1 [2023-02-21 15:24:21.936] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] providers: [2023-02-21 15:24:21.936] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - name: OceanBase Metrics [2023-02-21 15:24:21.936] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] type: file [2023-02-21 15:24:21.936] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] allowUiUpdates: 'true' [2023-02-21 15:24:21.936] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] options: [2023-02-21 15:24:21.936] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] path: /data/obdata/grafana/conf/provisioning/dashboards/templates to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:24:21.937] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:24:21.993] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:21.993] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- send /tmp/tmp1qtlpny5 to /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:24:22.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:24:22.062] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:24:22.064] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 15:24:22.142] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:22.142] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/41864/fd [2023-02-21 15:24:22.204] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:22.205] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: kill -9 41864 [2023-02-21 15:24:22.266] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:22.266] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cd /data/obdata/grafana; bash -c '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid > /data/obdata/grafana/data/log/grafana-console.log 2>&1 &' [2023-02-21 15:24:22.332] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:22.332] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 15:24:22.412] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:23.455] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] grafana program health check [2023-02-21 15:24:23.456] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:23.456] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:23.456] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:23.484] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:23.485] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:23.550] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:23.550] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:23.550] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:23.551] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 19 [2023-02-21 15:24:24.552] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:24.552] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:24.552] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:24.580] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:24.580] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:24.644] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:24.644] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:24.644] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:24.644] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 18 [2023-02-21 15:24:25.645] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:25.645] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:25.645] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:25.673] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:25.673] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:25.735] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:25.736] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:25.736] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:25.736] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 17 [2023-02-21 15:24:26.737] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:26.738] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:26.738] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:26.764] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:26.764] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:26.827] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:26.827] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:26.827] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:26.827] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 16 [2023-02-21 15:24:27.828] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:27.828] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:27.828] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:27.858] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:27.858] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:27.919] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:27.920] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:27.920] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:27.920] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 15 [2023-02-21 15:24:28.921] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:28.922] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:28.922] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:28.949] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:28.949] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:29.009] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:29.009] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:29.010] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:29.010] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 14 [2023-02-21 15:24:30.011] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:30.011] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:30.011] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:30.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:30.039] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:30.102] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:30.102] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:30.102] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:30.103] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 13 [2023-02-21 15:24:31.104] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:31.104] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:31.105] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:31.133] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:31.133] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:31.197] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:31.197] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:31.198] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:31.198] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 12 [2023-02-21 15:24:32.199] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:32.199] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:32.199] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:32.226] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:32.227] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:32.287] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:32.287] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:32.287] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:32.287] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 11 [2023-02-21 15:24:33.288] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:33.289] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:33.289] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:33.315] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:33.315] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:33.377] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:33.378] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:33.378] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:33.378] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 10 [2023-02-21 15:24:34.379] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:34.379] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:34.380] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:34.404] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:34.405] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:34.467] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:34.467] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:34.467] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:34.467] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 9 [2023-02-21 15:24:35.468] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:35.469] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:35.469] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:35.496] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:35.497] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:35.558] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:35.559] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:35.559] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:35.559] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 8 [2023-02-21 15:24:36.560] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:36.560] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:36.561] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:36.586] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:36.587] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:36.646] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:36.646] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:36.646] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:36.647] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 7 [2023-02-21 15:24:37.648] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:37.648] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:37.648] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:37.674] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:37.675] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:37.735] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:37.735] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:37.735] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:37.736] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 6 [2023-02-21 15:24:38.736] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:38.736] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:38.737] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:38.764] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:38.765] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:38.826] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:38.826] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:38.826] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:38.826] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 5 [2023-02-21 15:24:39.827] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:39.828] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:39.828] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:39.852] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:39.853] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:39.912] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:39.912] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:39.913] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:39.913] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 4 [2023-02-21 15:24:40.914] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:40.915] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:40.915] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:40.939] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:40.940] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:41.001] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:41.001] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:41.001] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:41.002] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 3 [2023-02-21 15:24:42.003] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:42.003] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:42.003] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:42.030] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:42.030] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:42.091] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:42.091] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:42.091] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:42.092] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 2 [2023-02-21 15:24:43.093] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:43.093] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:43.093] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:43.118] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:43.118] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:43.179] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:43.179] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:43.179] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:43.179] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 1 [2023-02-21 15:24:44.180] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- 10.253.208.63 program health check [2023-02-21 15:24:44.181] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- servers_pid: {<_deploy.ServerConfig object at 0x7fd01b074518>: ['']} [2023-02-21 15:24:44.181] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:44.210] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:44.210] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls -l /proc//fd/ |grep -E 'socket:\[(2104674181)\]' [2023-02-21 15:24:44.273] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 1, error output: [2023-02-21 15:24:44.273] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] ls: 无法访问/proc//fd/: 没有那个文件或目录 [2023-02-21 15:24:44.273] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:44.273] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- failed to start 10.253.208.63 grafana, remaining retries: 0 [2023-02-21 15:24:44.314] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [WARNING] [WARN] failed to start 10.253.208.63 grafana [2023-02-21 15:24:44.314] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub start ref count to 0 [2023-02-21 15:24:44.314] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export start [2023-02-21 15:24:44.314] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [ERROR] [ERROR] grafana start failed [2023-02-21 15:24:44.314] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:44.315] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import display [2023-02-21 15:24:44.316] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 15:24:44.316] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] Wait for observer init [2023-02-21 15:24:44.327] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 15:24:44.327] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | observer | [2023-02-21 15:24:44.327] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:24:44.327] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 15:24:44.327] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:24:44.327] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 15:24:44.327] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 15:24:44.327] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 15:24:44.327] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:24:44.327] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | observer | [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 15:24:44.448] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] [2023-02-21 15:24:44.449] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 15:24:44.449] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export display [2023-02-21 15:24:44.449] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:44.449] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import display [2023-02-21 15:24:44.450] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 15:24:44.455] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +-------------------------------------------------+ [2023-02-21 15:24:44.455] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | obproxy | [2023-02-21 15:24:44.455] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:24:44.455] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | ip | port | prometheus_port | status | [2023-02-21 15:24:44.455] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:24:44.455] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | 10.253.208.63 | 2883 | 2884 | active | [2023-02-21 15:24:44.455] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:24:44.456] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] obclient -h10.253.208.63 -P2883 -uroot -Doceanbase -A [2023-02-21 15:24:44.456] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 15:24:44.456] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export display [2023-02-21 15:24:44.456] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call obagent-py_script_display-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:44.456] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import display [2023-02-21 15:24:44.457] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 15:24:44.457] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.65:8088/metrics/stat" [2023-02-21 15:24:44.503] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:44.504] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.67:8088/metrics/stat" [2023-02-21 15:24:44.557] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:44.558] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.172:8088/metrics/stat" [2023-02-21 15:24:44.606] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:44.608] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +----------------------------------------------------+ [2023-02-21 15:24:44.608] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | obagent | [2023-02-21 15:24:44.608] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:24:44.608] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | ip | server_port | pprof_port | status | [2023-02-21 15:24:44.608] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:24:44.608] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | 10.253.208.65 | 8088 | 8089 | active | [2023-02-21 15:24:44.608] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | 10.253.208.67 | 8088 | 8089 | active | [2023-02-21 15:24:44.608] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | 10.253.208.172 | 8088 | 8089 | active | [2023-02-21 15:24:44.609] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:24:44.609] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 15:24:44.609] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export display [2023-02-21 15:24:44.609] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:44.609] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - import display [2023-02-21 15:24:44.610] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - add display ref count to 1 [2023-02-21 15:24:44.610] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] -- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 15:24:44.613] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +------------------------------------------------------+ [2023-02-21 15:24:44.613] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | prometheus | [2023-02-21 15:24:44.613] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:24:44.613] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 15:24:44.613] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:24:44.613] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] | http://10.253.208.63:9090 | | | active | [2023-02-21 15:24:44.613] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:24:44.613] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - sub display ref count to 0 [2023-02-21 15:24:44.614] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - export display [2023-02-21 15:24:44.614] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2023-02-21 15:24:44.614] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 15:24:44.614] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 15:24:44.614] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 15:24:44.614] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 15:24:44.614] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 15:24:44.614] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 15:24:44.614] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 15:24:44.615] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 15:24:44.615] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 15:24:44.615] [b8276f5c-b1b8-11ed-a75d-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global [2023-02-21 15:24:54.312] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2023-02-21 15:24:54.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2023-02-21 15:24:54.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2023-02-21 15:24:54.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - cmd: ['observer'] [2023-02-21 15:24:54.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - opts: {'servers': None, 'components': None, 'with_parameter': None} [2023-02-21 15:24:54.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Get Deploy by name [2023-02-21 15:24:54.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2023-02-21 15:24:54.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2023-02-21 15:24:54.314] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_observer [2023-02-21 15:24:54.314] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_observer`, count 1 [2023-02-21 15:24:54.324] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Get local repositories and plugins [2023-02-21 15:24:54.368] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/repository [2023-02-21 15:24:54.368] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Get local repository oceanbase-ce-4.0.0.0-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:54.369] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 15:24:54.369] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2023-02-21 15:24:54.371] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Get local repository obproxy-ce-4.0.0-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:54.371] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2023-02-21 15:24:54.373] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Get local repository obagent-1.2.0-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:54.374] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2023-02-21 15:24:54.376] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Get local repository prometheus-2.37.1-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:54.376] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2023-02-21 15:24:54.378] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:54.379] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 5 [2023-02-21 15:24:54.381] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching restart plugin for components ... [2023-02-21 15:24:54.381] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching restart plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:54.382] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2023-02-21 15:24:54.383] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_restart-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:54.383] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching restart plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:54.383] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_restart-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:54.383] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching restart plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:54.383] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_restart-0.1 for obagent-1.2.0 [2023-02-21 15:24:54.383] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching restart plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:54.383] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_restart-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:54.383] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching restart plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:54.384] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_restart-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:54.384] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching reload plugin for components ... [2023-02-21 15:24:54.384] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching reload plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:54.384] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_reload-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:54.384] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching reload plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:54.384] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_reload-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:54.385] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching reload plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:54.385] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_reload-0.1 for obagent-1.2.0 [2023-02-21 15:24:54.385] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching reload plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:54.385] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_reload-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:54.385] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching reload plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:54.385] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_reload-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:54.385] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching start plugin for components ... [2023-02-21 15:24:54.385] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:54.386] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:54.386] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching start plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:54.386] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:54.386] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching start plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:54.386] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_start-1.1.0 for obagent-1.2.0 [2023-02-21 15:24:54.386] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching start plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:54.387] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_start-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:54.387] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching start plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:54.387] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_start-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:54.387] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching stop plugin for components ... [2023-02-21 15:24:54.387] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:54.387] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:54.387] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:54.388] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:54.388] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching stop plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:54.388] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_stop-0.1 for obagent-1.2.0 [2023-02-21 15:24:54.388] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching stop plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:54.388] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_stop-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:54.388] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching stop plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:54.388] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_stop-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:54.389] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching connect plugin for components ... [2023-02-21 15:24:54.389] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:54.389] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:54.389] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:54.389] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:54.389] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching connect plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:54.390] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_connect-0.1 for obagent-1.2.0 [2023-02-21 15:24:54.390] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:54.390] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:54.390] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:54.390] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:54.390] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching display plugin for components ... [2023-02-21 15:24:54.390] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:54.391] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:54.391] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching display plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:54.391] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:54.391] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching display plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:54.391] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_display-0.1 for obagent-1.2.0 [2023-02-21 15:24:54.391] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching display plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:54.391] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_display-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:54.391] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching display plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:54.392] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_display-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:54.392] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for components ... [2023-02-21 15:24:54.392] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:54.392] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:54.392] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:54.392] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:54.393] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:54.393] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.2.0 [2023-02-21 15:24:54.393] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:54.393] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_bootstrap-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:54.393] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching bootstrap plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:54.393] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_bootstrap-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:54.461] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Load cluster param plugin [2023-02-21 15:24:54.462] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching param plugin for components ... [2023-02-21 15:24:54.462] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Search param plugin for oceanbase-ce [2023-02-21 15:24:54.463] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:54.464] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:55.171] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Search param plugin for obproxy-ce [2023-02-21 15:24:55.171] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:55.171] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:55.333] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Search param plugin for obagent [2023-02-21 15:24:55.334] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obagent-param-1.1.0 for obagent-1.2.0 [2023-02-21 15:24:55.334] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Applying obagent-param-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:55.431] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Search param plugin for prometheus [2023-02-21 15:24:55.431] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:55.432] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:55.454] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Search param plugin for grafana [2023-02-21 15:24:55.454] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:55.454] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:55.488] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Open ssh connection [2023-02-21 15:24:56.403] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Cluster status check [2023-02-21 15:24:56.404] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching status plugin for components ... [2023-02-21 15:24:56.404] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching status plugin for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:56.405] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0 [2023-02-21 15:24:56.405] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching status plugin for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:56.405] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0 [2023-02-21 15:24:56.405] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching status plugin for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:56.405] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for obagent-py_script_status-0.1 for obagent-1.2.0 [2023-02-21 15:24:56.405] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching status plugin for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:56.406] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for prometheus-py_script_status-2.37.1 for prometheus-2.37.1 [2023-02-21 15:24:56.406] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Searching status plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:56.406] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Found for grafana-py_script_status-7.5.17 for grafana-7.5.17 [2023-02-21 15:24:56.406] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:56.406] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:24:56.407] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:24:56.407] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:56.446] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:56.447] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/143484 [2023-02-21 15:24:56.511] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:56.512] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:56.613] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:56.614] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/49303 [2023-02-21 15:24:56.676] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:56.676] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:56.737] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:56.738] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/241247 [2023-02-21 15:24:56.815] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:56.815] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:24:56.815] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:24:56.815] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:24:56.815] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:24:56.816] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:24:56.817] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:24:56.841] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:56.841] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/41269 [2023-02-21 15:24:56.900] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:56.901] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:24:56.901] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:24:56.901] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Call obagent-py_script_status-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:24:56.901] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:24:56.902] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:24:56.902] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:24:56.926] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:56.926] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.65 execute: ls /proc/144427 [2023-02-21 15:24:56.991] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:56.991] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:24:57.012] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:57.012] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.67 execute: ls /proc/50237 [2023-02-21 15:24:57.074] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:57.074] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:24:57.109] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:57.110] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.172 execute: ls /proc/242293 [2023-02-21 15:24:57.176] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:57.177] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:24:57.177] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:24:57.177] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_status-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:24:57.177] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:24:57.178] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:24:57.178] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:24:57.198] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:57.199] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/45321 [2023-02-21 15:24:57.259] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:57.260] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:24:57.260] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:24:57.260] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Call grafana-py_script_status-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:24:57.261] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - import status [2023-02-21 15:24:57.261] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - add status ref count to 1 [2023-02-21 15:24:57.262] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:24:57.319] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:57.320] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- admin@10.253.208.63 execute: ls /proc/45563 [2023-02-21 15:24:57.381] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- exited code 0 [2023-02-21 15:24:57.381] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - sub status ref count to 0 [2023-02-21 15:24:57.381] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - export status [2023-02-21 15:24:57.447] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Call oceanbase-ce-py_script_restart-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:57.447] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:24:57.450] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:24:57.450] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:57.450] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Connect to observer [2023-02-21 15:24:57.451] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:24:57.488] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:24:57.489] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 15:24:57.491] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:24:57.491] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:24:57.581] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:24:57.582] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:24:57.583] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: set session ob_query_timeout=1000000000. args: None [2023-02-21 15:24:57.583] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2023-02-21 15:24:57.584] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Server check [2023-02-21 15:24:57.585] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server. args: None [2023-02-21 15:24:57.585] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server [2023-02-21 15:24:57.587] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- [{'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 101577), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 13, 40, 864416), 'svr_ip': '10.253.208.172', 'svr_port': 2882, 'id': 3, 'zone': 'zone3', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 1676963618884916, 'first_sessid': 0, 'with_partition': 1}, {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 223333), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 13, 39, 845662), 'svr_ip': '10.253.208.65', 'svr_port': 2882, 'id': 1, 'zone': 'zone1', 'inner_port': 2881, 'with_rootserver': 1, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 1676963617852208, 'first_sessid': 0, 'with_partition': 1}, {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 100518), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 13, 39, 748202), 'svr_ip': '10.253.208.67', 'svr_port': 2882, 'id': 2, 'zone': 'zone2', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 1676963617754157, 'first_sessid': 0, 'with_partition': 1}] [2023-02-21 15:24:57.716] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Observer restart [2023-02-21 15:24:57.719] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:57.719] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:24:57.721] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:24:57.721] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:57.749] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:57.749] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ps uax | egrep " 143484 " | grep -v grep [2023-02-21 15:24:57.857] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:57.857] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) observer[pid:143484] stopping ... [2023-02-21 15:24:57.857] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: kill -9 143484 [2023-02-21 15:24:57.922] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:57.922] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:57.974] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:57.974] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ps uax | egrep " 49303 " | grep -v grep [2023-02-21 15:24:58.067] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:58.067] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) observer[pid:49303] stopping ... [2023-02-21 15:24:58.067] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: kill -9 49303 [2023-02-21 15:24:58.126] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:58.126] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:58.154] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:58.154] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ps uax | egrep " 241247 " | grep -v grep [2023-02-21 15:24:58.240] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:58.241] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) observer[pid:241247] stopping ... [2023-02-21 15:24:58.241] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: kill -9 241247 [2023-02-21 15:24:58.319] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.321] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) check whether the port is released [2023-02-21 15:24:59.321] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:59.350] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.351] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:59.417] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.418] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 15:24:59.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.480] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) observer is stopped [2023-02-21 15:24:59.480] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) check whether the port is released [2023-02-21 15:24:59.481] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:59.505] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.505] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:59.571] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.571] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 15:24:59.633] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.633] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) observer is stopped [2023-02-21 15:24:59.633] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) check whether the port is released [2023-02-21 15:24:59.633] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:59.671] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.672] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:24:59.743] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.744] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: rm -f /home/admin/observer/run/observer.pid [2023-02-21 15:24:59.809] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.810] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) observer is stopped [2023-02-21 15:24:59.810] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:24:59.810] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:24:59.810] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:24:59.810] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:24:59.812] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:24:59.813] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:59.835] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:24:59.835] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 15:24:59.835] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:59.836] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) start command construction [2023-02-21 15:24:59.836] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 15:24:59.897] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.897] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:24:59.920] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:24:59.920] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 15:24:59.920] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:24:59.921] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) start command construction [2023-02-21 15:24:59.921] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 15:24:59.979] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:24:59.980] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:25:00.009] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:25:00.010] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] cat: /home/admin/observer/run/observer.pid: 没有那个文件或目录 [2023-02-21 15:25:00.010] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:00.010] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) start command construction [2023-02-21 15:25:00.010] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ls /home/admin/observer/etc/observer.config.bin [2023-02-21 15:25:00.079] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:00.080] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- starting server1(10.253.208.65) observer [2023-02-21 15:25:00.081] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 15:25:00.081] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 15:25:00.269] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:00.270] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 delete env LD_LIBRARY_PATH [2023-02-21 15:25:00.270] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- starting server2(10.253.208.67) observer [2023-02-21 15:25:00.270] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 15:25:00.270] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 15:25:00.397] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:00.398] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 delete env LD_LIBRARY_PATH [2023-02-21 15:25:00.398] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- starting server3(10.253.208.172) observer [2023-02-21 15:25:00.398] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 set env LD_LIBRARY_PATH to '/home/admin/observer/lib:' [2023-02-21 15:25:00.398] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cd /home/admin/observer; /home/admin/observer/bin/observer -p 2881 [2023-02-21 15:25:01.528] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:01.528] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 delete env LD_LIBRARY_PATH [2023-02-21 15:25:04.532] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) program health check [2023-02-21 15:25:04.532] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:25:04.558] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:04.558] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ls /proc/145970 [2023-02-21 15:25:04.624] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:04.625] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) observer[pid: 145970] started [2023-02-21 15:25:04.625] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) program health check [2023-02-21 15:25:04.625] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:25:04.672] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:04.672] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ls /proc/51722 [2023-02-21 15:25:04.757] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:04.758] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) observer[pid: 51722] started [2023-02-21 15:25:04.758] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) program health check [2023-02-21 15:25:04.758] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/observer/run/observer.pid [2023-02-21 15:25:04.857] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:04.858] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ls /proc/244224 [2023-02-21 15:25:05.010] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:05.010] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) observer[pid: 244224] started [2023-02-21 15:25:05.011] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:25:05.011] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:25:05.011] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: select version(). args: None [2023-02-21 15:25:05.011] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: select version() [2023-02-21 15:25:05.012] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:25:05.012] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:25:05.012] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:25:05.012] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 59, in connect [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if self.cursor is None or self.execute_sql('select version()', error=False) is False: [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 692, in _read_packet [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] packet_header = self._read_bytes(4) [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 749, in _read_bytes [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] CR.CR_SERVER_LOST, "Lost connection to MySQL server during query" [2023-02-21 15:25:05.013] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query') [2023-02-21 15:25:05.014] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] [2023-02-21 15:25:05.014] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.0.0.0-103000022023011215.el7-1d56dc742f5f05a2d15797d291b51a94019e728d [2023-02-21 15:25:05.014] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- connect 10.253.208.65 -P2881 -uroot -p [2023-02-21 15:25:05.016] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:25:05.016] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:25:05.018] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:25:05.018] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:25:05.018] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:25:05.019] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:25:05.020] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:25:05.020] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:25:05.020] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:25:05.020] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] [2023-02-21 15:25:07.022] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:25:07.022] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:25:07.024] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:25:07.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] [2023-02-21 15:25:09.027] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:25:09.028] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:25:09.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:25:09.031] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:25:09.032] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:25:09.032] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:25:09.032] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:25:09.032] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] [2023-02-21 15:25:11.034] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:25:11.034] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:25:11.036] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:25:11.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] [2023-02-21 15:25:13.038] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:25:13.039] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:25:13.041] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:25:13.041] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:25:13.041] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:25:13.041] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:25:13.041] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:25:13.041] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:25:13.041] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:25:13.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:25:13.043] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:25:13.043] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:25:13.043] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:25:13.043] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:25:13.043] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:25:13.043] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:25:13.043] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:25:13.043] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] [2023-02-21 15:25:15.045] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:25:15.045] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:25:15.047] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:25:15.047] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:25:15.047] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:25:15.047] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:25:15.047] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:25:15.048] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:25:15.049] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:25:15.049] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:25:15.049] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:25:15.049] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] [2023-02-21 15:25:17.051] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:25:17.051] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:25:17.053] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:25:17.053] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:25:17.053] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:25:17.053] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:25:17.053] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:25:17.053] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:25:17.053] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:25:17.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:25:17.055] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] [2023-02-21 15:25:19.058] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:25:19.058] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] Traceback (most recent call last): [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "core.py", line 2055, in restart_cluster [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 242, in __call__ [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "_plugin.py", line 216, in _new_func [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 288, in restart [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if call(): [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 266, in restart [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] ret = self.un_rolling() [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 238, in un_rolling [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.wait() [2023-02-21 15:25:19.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 97, in wait [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] if not self.connect(): [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 70, in connect [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] while self.execute_sql('use oceanbase', error=False) is False: [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.obd/plugins/oceanbase-ce/4.0.0.0/restart.py", line 80, in execute_sql [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self.cursor.execute(query, args) [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 148, in execute [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result = self._query(query) [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/cursors.py", line 310, in _query [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] conn.query(q) [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 548, in query [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] self._affected_rows = self._read_query_result(unbuffered=unbuffered) [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 775, in _read_query_result [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] result.read() [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 1156, in read [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] first_packet = self.connection._read_packet() [2023-02-21 15:25:19.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/connections.py", line 725, in _read_packet [2023-02-21 15:25:19.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] packet.raise_for_error() [2023-02-21 15:25:19.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/protocol.py", line 221, in raise_for_error [2023-02-21 15:25:19.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] err.raise_mysql_exception(self._data) [2023-02-21 15:25:19.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] File "/home/admin/.oceanbase-all-in-one/obd/usr/obd/lib/site-packages/pymysql/err.py", line 143, in raise_mysql_exception [2023-02-21 15:25:19.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] raise errorclass(errno, errval) [2023-02-21 15:25:19.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] pymysql.err.OperationalError: (1049, 'Unknown database') [2023-02-21 15:25:19.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [ERROR] [2023-02-21 15:25:21.064] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: use oceanbase. args: None [2023-02-21 15:25:21.064] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: use oceanbase [2023-02-21 15:25:21.065] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: set session ob_query_timeout=1000000000. args: None [2023-02-21 15:25:21.066] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: set session ob_query_timeout=1000000000 [2023-02-21 15:25:21.067] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- server check [2023-02-21 15:25:21.067] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0. args: None [2023-02-21 15:25:21.067] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0 [2023-02-21 15:25:21.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 101577), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 25, 20, 201347), 'svr_ip': '10.253.208.172', 'svr_port': 2882, 'id': 3, 'zone': 'zone3', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 0, 'first_sessid': 0, 'with_partition': 1} [2023-02-21 15:25:24.074] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0. args: None [2023-02-21 15:25:24.074] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0 [2023-02-21 15:25:24.075] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- {'gmt_create': datetime.datetime(2023, 2, 21, 11, 32, 39, 100518), 'gmt_modified': datetime.datetime(2023, 2, 21, 15, 25, 20, 202165), 'svr_ip': '10.253.208.67', 'svr_port': 2882, 'id': 2, 'zone': 'zone2', 'inner_port': 2881, 'with_rootserver': 0, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.0.0.0_103000022023011215-05bbad0279302d7274e1b5ab79323a2c915c1981(Jan 12 2023 15:28:27)', 'stop_time': 0, 'start_service_time': 0, 'first_sessid': 0, 'with_partition': 1} [2023-02-21 15:25:27.076] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0. args: None [2023-02-21 15:25:27.076] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0 [2023-02-21 15:25:27.178] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- query: select version(). args: None [2023-02-21 15:25:27.178] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- execute sql: select version() [2023-02-21 15:25:27.180] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- {'version()': '5.7.25-OceanBase_CE-v4.0.0.0'} [2023-02-21 15:25:27.180] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:25:27.181] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:25:27.181] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Wait for observer init [2023-02-21 15:25:27.186] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 15:25:27.186] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | observer | [2023-02-21 15:25:27.186] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:25:27.186] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 15:25:27.186] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:25:27.186] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 15:25:27.186] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 15:25:27.186] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 15:25:27.186] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:25:27.186] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 15:25:27.312] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +--------------------------------------------------+ [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | observer | [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | ip | version | port | zone | status | [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | 10.253.208.172 | 4.0.0.0 | 2881 | zone3 | ACTIVE | [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | 10.253.208.65 | 4.0.0.0 | 2881 | zone1 | ACTIVE | [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | 10.253.208.67 | 4.0.0.0 | 2881 | zone2 | ACTIVE | [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +----------------+---------+------+-------+--------+ [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] obclient -h10.253.208.172 -P2881 -uroot -Doceanbase -A [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:25:27.313] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:25:27.314] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Call obproxy-ce-py_script_restart-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:25:27.314] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:25:27.315] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:25:27.315] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:25:27.316] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:25:27.317] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:25:27.317] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Stop obproxy [2023-02-21 15:25:27.318] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:27.341] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:27.341] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/41269 [2023-02-21 15:25:27.403] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:27.404] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/41269/fd [2023-02-21 15:25:27.463] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:27.463] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 obproxy[pid:41269] stopping ... [2023-02-21 15:25:27.464] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid | xargs kill -9; kill -9 -41269 [2023-02-21 15:25:27.523] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:28.525] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 check whether the port is released [2023-02-21 15:25:28.525] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:28.551] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:28.552] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:28.615] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:28.616] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: rm -f /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:28.676] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:28.677] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 obproxy is stopped [2023-02-21 15:25:28.752] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:25:28.752] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:25:28.752] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:25:28.753] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:25:28.755] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:25:28.757] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Start obproxy [2023-02-21 15:25:28.774] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/obproxy/etc/obproxy_config.bin [2023-02-21 15:25:28.796] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:28.797] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 port check [2023-02-21 15:25:28.797] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:28.858] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:25:28.859] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] cat: /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid: 没有那个文件或目录 [2023-02-21 15:25:28.859] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:28.859] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- starting 10.253.208.63 obproxy [2023-02-21 15:25:28.860] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 set env LD_LIBRARY_PATH to '/data/obdata/obproxy/lib:' [2023-02-21 15:25:28.860] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/obproxy; /data/obdata/obproxy/bin/obproxy --listen_port 2883 [2023-02-21 15:25:29.083] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:29.083] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 delete env LD_LIBRARY_PATH [2023-02-21 15:25:29.084] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/obproxy/bin/obproxy --listen_port 2883$' | grep -v grep | awk '{print $2}' > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:29.178] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:29.292] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] obproxy program health check [2023-02-21 15:25:29.293] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:25:29.293] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:29.317] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:29.318] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:29.384] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:29.384] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 19 [2023-02-21 15:25:30.385] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:25:30.386] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:30.410] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:30.411] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:30.475] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:30.475] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 18 [2023-02-21 15:25:31.476] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:25:31.477] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:31.499] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:31.500] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:31.565] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:31.565] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 2104674743 [2023-02-21 15:25:31.565] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:31.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/46740/fd/ |grep -E 'socket:\[(2104674743)\]' [2023-02-21 15:25:31.629] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:31.630] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 15:25:31.693] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 2, error output: [2023-02-21 15:25:31.693] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/41245: 没有那个文件或目录 [2023-02-21 15:25:31.694] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:31.694] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: echo 46740 > /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:31.755] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:31.836] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:25:31.837] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/obproxy && rm -fr /data/obdata/obproxy/obproxyd.sh [2023-02-21 15:25:31.860] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:31.861] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /home/admin/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /data/obdata/obproxy/obproxyd.sh [2023-02-21 15:25:31.906] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/obproxy/obproxyd.sh [2023-02-21 15:25:31.928] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:31.929] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash /data/obdata/obproxy/obproxyd.sh /data/obdata/obproxy 10.253.208.63 2883 [2023-02-21 15:25:31.995] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:32.998] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:25:32.999] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:33.022] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:33.023] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:33.089] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:33.089] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 16 [2023-02-21 15:25:34.090] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:25:34.090] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:34.112] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:34.112] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:34.178] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:34.178] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 obproxy, remaining retries: 15 [2023-02-21 15:25:35.180] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:25:35.180] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/obproxy/run/obproxy-10.253.208.63-2883.pid [2023-02-21 15:25:35.210] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:35.211] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:35.280] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:35.280] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 2104674889 [2023-02-21 15:25:35.281] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:35.281] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/46998/fd/ |grep -E 'socket:\[(2104674889)\]' [2023-02-21 15:25:35.347] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:35.348] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/obproxy/run/obproxyd-10.253.208.63-2883.pid` && ls /proc/$pid [2023-02-21 15:25:35.413] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:35.414] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 obproxy[pid: 46998] started [2023-02-21 15:25:35.421] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:25:35.421] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:25:35.421] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:25:35.422] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Connect to obproxy [2023-02-21 15:25:35.422] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:25:35.424] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:25:35.424] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- connect 10.253.208.63 -P2883 -uroot@proxysys -p [2023-02-21 15:25:35.426] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:25:35.426] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:25:35.553] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.0.0-5.el7-de53232a951184fad75b15884458d85e31d2f6c3 [2023-02-21 15:25:35.553] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:25:35.554] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:25:35.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +-------------------------------------------------+ [2023-02-21 15:25:35.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | obproxy | [2023-02-21 15:25:35.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:25:35.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | ip | port | prometheus_port | status | [2023-02-21 15:25:35.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:25:35.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | 10.253.208.63 | 2883 | 2884 | active | [2023-02-21 15:25:35.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +---------------+------+-----------------+--------+ [2023-02-21 15:25:35.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] obclient -h10.253.208.63 -P2883 -uroot -Doceanbase -A [2023-02-21 15:25:35.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:25:35.566] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:25:35.567] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:25:35.567] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:25:35.567] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Call obagent-py_script_restart-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:25:35.567] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:25:35.568] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:25:35.568] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call obagent-py_script_stop-0.1 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:25:35.568] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:25:35.569] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:25:35.570] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Stop obagent [2023-02-21 15:25:35.570] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:25:35.593] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:35.594] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: ls /proc/144427 [2023-02-21 15:25:35.655] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:35.656] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) obagent[pid:144427] stopping ... [2023-02-21 15:25:35.656] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: kill -9 144427 [2023-02-21 15:25:35.717] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:35.718] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:25:35.743] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:35.744] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: ls /proc/50237 [2023-02-21 15:25:35.843] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:35.843] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) obagent[pid:50237] stopping ... [2023-02-21 15:25:35.844] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: kill -9 50237 [2023-02-21 15:25:35.952] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:35.952] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:25:36.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:36.025] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: ls /proc/242293 [2023-02-21 15:25:36.094] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:36.095] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) obagent[pid:242293] stopping ... [2023-02-21 15:25:36.095] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: kill -9 242293 [2023-02-21 15:25:36.161] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:37.163] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) check whether the port is released [2023-02-21 15:25:37.163] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:37.193] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:37.193] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:37.260] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:37.261] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:25:37.324] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:37.324] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) obagent is stopped [2023-02-21 15:25:37.324] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) check whether the port is released [2023-02-21 15:25:37.324] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:37.355] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:37.356] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:37.423] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:37.424] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:25:37.481] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:37.482] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) obagent is stopped [2023-02-21 15:25:37.482] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) check whether the port is released [2023-02-21 15:25:37.482] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:37.520] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:37.521] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:37.606] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:37.606] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: rm -f /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:25:37.676] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:37.676] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) obagent is stopped [2023-02-21 15:25:37.787] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:25:37.787] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:25:37.787] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call obagent-py_script_start-1.1.0 for obagent-1.2.0-4.el7-0e8f5ee68c337ea28514c9f3f820ea546227fa7e [2023-02-21 15:25:37.787] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:25:37.875] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:25:37.876] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Start obagent [2023-02-21 15:25:37.913] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:25:37.936] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:25:37.937] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.65-8088.pid: 没有那个文件或目录 [2023-02-21 15:25:37.937] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:37.938] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:38.022] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:25:38.022] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:38.043] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:38.043] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp4fp6hp0j.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:38.089] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:38.112] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:38.115] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:38.116] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:38.175] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:38.176] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp3vu4bsju.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:38.222] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:38.243] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:38.246] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:38.247] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:38.307] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:38.307] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp3c6sk3x_.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:38.353] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:38.375] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:38.378] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 15:25:38.379] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:25:38.437] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:38.438] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp_4x9x1k0.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:25:38.482] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:25:38.504] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:38.507] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:38.507] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:38.568] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:38.569] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpjjze2gt6.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:38.614] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:38.639] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:38.643] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:38.643] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:38.703] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:38.704] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpxn5i3z56.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:38.750] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:38.773] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:38.778] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:38.778] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:38.836] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:38.837] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpdpuf7534.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:38.886] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:38.907] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:38.914] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:38.915] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:38.969] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:38.970] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpb4jyil8b.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:39.017] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:39.039] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:39.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:39.042] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:39.103] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:39.103] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpit0pdkg2.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:39.148] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:39.171] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:39.178] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:25:39.237] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:39.237] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp0y1mqp4p.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:25:39.282] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.65 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:25:39.303] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:39.307] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:25:39.366] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:39.367] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:25:39.386] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:25:39.387] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.67-8088.pid: 没有那个文件或目录 [2023-02-21 15:25:39.387] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:39.388] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:39.466] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:25:39.467] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:39.486] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:39.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpoxpmsavx.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:39.535] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:39.554] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:39.557] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:39.558] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:39.614] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:39.614] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp00gzlm5c.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:39.664] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:39.683] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:39.686] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:39.687] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:39.743] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:39.744] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpw2cklu8a.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:39.791] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:39.813] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:39.816] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 15:25:39.817] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:25:39.874] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:39.874] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp7jy8vmne.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:25:39.922] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:25:39.941] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:39.944] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:39.944] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:40.009] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:40.010] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp0wn7kuhs.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:40.059] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:40.080] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:40.083] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:40.084] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:40.141] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:40.141] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpnehx4m3i.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:40.191] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:40.210] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:40.214] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:40.215] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:40.270] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:40.271] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpijuu5ttj.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:40.325] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:40.344] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:40.351] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:40.351] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:40.404] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:40.404] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpio1gwvvs.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:40.452] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:40.471] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:40.474] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:40.475] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:40.530] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:40.531] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp_sdylb2o.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:40.580] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:40.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:40.607] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:25:40.667] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:40.667] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpgo2y8o2e.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:25:40.715] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.67 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:25:40.755] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:40.759] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:25:40.820] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:40.821] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:25:40.852] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 1, error output: [2023-02-21 15:25:40.853] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] cat: /home/admin/obagent/run/obagent-10.253.208.172-8088.pid: 没有那个文件或目录 [2023-02-21 15:25:40.853] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:40.853] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:40.953] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2023-02-21 15:25:40.954] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:40.982] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:40.982] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpu7nm4dgz.yaml to /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:41.026] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_basic_auth.yaml [2023-02-21 15:25:41.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:41.057] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:41.058] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/config_properties && rm -fr /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:41.133] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:41.134] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpca9iqo_v.yaml to /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:41.180] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/config_properties/monagent_pipeline.yaml [2023-02-21 15:25:41.210] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:41.214] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:41.215] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:41.279] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:41.279] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp0_r7bhcl.yaml to /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:41.324] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_basic_auth.yaml [2023-02-21 15:25:41.349] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:41.352] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monagent_config.yaml [2023-02-21 15:25:41.353] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:25:41.419] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:41.420] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp6xsocja8.yaml to /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:25:41.463] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monagent_config.yaml [2023-02-21 15:25:41.484] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:41.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:41.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:41.549] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:41.549] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmptiqcrxu0.yaml to /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:41.594] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_mysql.yaml [2023-02-21 15:25:41.615] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:41.618] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:41.619] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:41.678] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:41.678] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpzffvzay6.yaml to /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:41.725] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_node_host.yaml [2023-02-21 15:25:41.746] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:41.749] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:41.750] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:41.811] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:41.812] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpha5o3tbx.yaml to /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:41.860] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob.yaml [2023-02-21 15:25:41.885] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:41.891] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:41.892] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/module_config && rm -fr /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:41.984] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:41.985] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpf5vrdw9g.yaml to /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:42.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/module_config/monitor_ob_log.yaml [2023-02-21 15:25:42.056] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:42.059] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- format /home/admin/.obd/repository/obagent/1.2.0/0e8f5ee68c337ea28514c9f3f820ea546227fa7e/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:42.060] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf/prometheus_config && rm -fr /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:42.135] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:42.135] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpt3t607cl.yaml to /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:42.180] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/prometheus_config/prometheus.yaml [2023-02-21 15:25:42.207] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:42.214] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: mkdir -p /home/admin/obagent/conf && rm -fr /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:25:42.276] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:42.276] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpn0tof2w0.yaml to /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:25:42.321] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.172 execute: chmod 600 /home/admin/obagent/conf/monagent.yaml [2023-02-21 15:25:42.344] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:42.347] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cd /home/admin/obagent;nohup /home/admin/obagent/bin/monagent -c conf/monagent.yaml >> /home/admin/obagent/log/monagent_stdout.log 2>&1 & echo $! > /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:25:42.404] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:42.440] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] obagent program health check [2023-02-21 15:25:43.442] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server1(10.253.208.65) program health check [2023-02-21 15:25:43.442] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: cat /home/admin/obagent/run/obagent-10.253.208.65-8088.pid [2023-02-21 15:25:43.468] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:43.468] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:43.537] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:43.537] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server2(10.253.208.67) program health check [2023-02-21 15:25:43.538] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: cat /home/admin/obagent/run/obagent-10.253.208.67-8088.pid [2023-02-21 15:25:43.560] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:43.561] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:43.632] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:43.632] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- server3(10.253.208.172) program health check [2023-02-21 15:25:43.632] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: cat /home/admin/obagent/run/obagent-10.253.208.172-8088.pid [2023-02-21 15:25:43.693] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:43.694] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:43.812] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:43.813] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- start to sync target config [2023-02-21 15:25:43.874] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:25:43.875] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:25:43.875] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:25:43.875] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:25:43.876] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.65 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.65:8088/metrics/stat" [2023-02-21 15:25:43.912] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:43.913] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.67 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.67:8088/metrics/stat" [2023-02-21 15:25:43.969] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:43.969] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.172 execute: curl --user admin:root -H "Content-Type:application/json" -L "http://10.253.208.172:8088/metrics/stat" [2023-02-21 15:25:44.059] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:44.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +----------------------------------------------------+ [2023-02-21 15:25:44.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | obagent | [2023-02-21 15:25:44.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:25:44.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | ip | server_port | pprof_port | status | [2023-02-21 15:25:44.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:25:44.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | 10.253.208.65 | 8088 | 8089 | active | [2023-02-21 15:25:44.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | 10.253.208.67 | 8088 | 8089 | active | [2023-02-21 15:25:44.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | 10.253.208.172 | 8088 | 8089 | active | [2023-02-21 15:25:44.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +----------------+-------------+------------+--------+ [2023-02-21 15:25:44.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:25:44.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:25:44.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:25:44.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:25:44.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Call prometheus-py_script_restart-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:25:44.062] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:25:44.064] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:25:44.064] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_stop-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:25:44.064] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:25:44.065] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:25:44.065] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Stop prometheus [2023-02-21 15:25:44.066] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:25:44.089] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:44.089] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/45321 [2023-02-21 15:25:44.150] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:44.151] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/45321/fd [2023-02-21 15:25:44.212] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:44.212] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 prometheus[pid:45321] stopping... [2023-02-21 15:25:44.212] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheusd.pid | xargs kill -9; kill -9 45321 [2023-02-21 15:25:44.274] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:45.276] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 check whether the port is released [2023-02-21 15:25:45.277] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp,udp}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:45.301] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:45.302] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: rm -f /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:25:45.362] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:45.362] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 prometheus is stopped [2023-02-21 15:25:45.370] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:25:45.370] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:25:45.370] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_start-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:25:45.371] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:25:45.373] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:25:45.374] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Start promethues [2023-02-21 15:25:45.375] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/prometheus/.prometheus_started [2023-02-21 15:25:45.422] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:45.422] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:25:45.482] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:45.483] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:25:45.544] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:45.597] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- write global: [2023-02-21 15:25:45.597] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] scrape_interval: 1s [2023-02-21 15:25:45.597] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] evaluation_interval: 10s [2023-02-21 15:25:45.597] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] rule_files: [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - rules/*rules.yaml [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] scrape_configs: [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - job_name: prometheus [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] metrics_path: /metrics [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.63:9090 [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - job_name: node [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] metrics_path: /metrics/node/host [2023-02-21 15:25:45.598] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - job_name: ob_basic [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/basic [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:25:45.599] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - job_name: ob_extra [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] metrics_path: /metrics/ob/extra [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:25:45.600] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - targets/*.yaml [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - job_name: agent [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] basic_auth: [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] username: admin [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] password: root [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] metrics_path: /metrics/stat [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] scheme: http [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] static_configs: [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - targets: [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.65:8088 [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.67:8088 [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - 10.253.208.172:8088 [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] file_sd_configs: [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - files: [2023-02-21 15:25:45.601] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - targets/*.yaml to admin@10.253.208.63:22: /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:25:45.602] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:25:45.628] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:45.628] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmpgwijdaqy to /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:25:45.675] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/prometheus/prometheus.yaml [2023-02-21 15:25:45.699] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:45.703] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:25:45.763] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:45.763] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:25:45.808] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:25:45.831] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:45.831] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle --start-only [2023-02-21 15:25:45.940] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:45.941] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheus.pid` && ls /proc/$pid [2023-02-21 15:25:46.009] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:47.028] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] prometheus program health check [2023-02-21 15:25:47.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:25:47.030] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:25:47.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:47.054] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:47.121] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:47.121] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 2104678753 [2023-02-21 15:25:47.121] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:47.122] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/47370/fd/ |grep -E 'socket:\[(2104678753)\]' [2023-02-21 15:25:47.189] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:47.189] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 15:25:47.254] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 2, error output: [2023-02-21 15:25:47.255] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ls: 无法访问/proc/45292: 没有那个文件或目录 [2023-02-21 15:25:47.255] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:47.255] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/prometheus && rm -fr /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:25:47.327] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:47.327] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /home/admin/.obd/plugins/prometheus/2.37.1/prometheusd.sh to /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:25:47.373] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 644 /data/obdata/prometheus/prometheusd.sh [2023-02-21 15:25:47.399] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:47.399] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/prometheus && bash prometheusd.sh --config.file=/data/obdata/prometheus/prometheus.yaml --web.listen-address=0.0.0.0:9090 --storage.tsdb.path=/data/obdata/prometheus/data --web.enable-lifecycle [2023-02-21 15:25:47.495] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:48.497] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:25:48.497] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:25:48.522] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:48.523] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:48.595] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:48.596] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- failed to start 10.253.208.63 prometheus, remaining retries: 18 [2023-02-21 15:25:49.597] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:25:49.597] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/prometheus/run/prometheus.pid [2023-02-21 15:25:49.626] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:49.626] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:2382' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:49.695] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:49.696] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 2104678192 [2023-02-21 15:25:49.696] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:49.696] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/47532/fd/ |grep -E 'socket:\[(2104678192)\]' [2023-02-21 15:25:49.766] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:49.766] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: pid=`cat /data/obdata/prometheus/run/prometheusd.pid` && ls /proc/$pid [2023-02-21 15:25:49.837] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:49.837] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 prometheusd[pid: 47532] started [2023-02-21 15:25:49.904] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:25:49.904] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:25:49.905] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_connect-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:25:49.905] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Connect to prometheus [2023-02-21 15:25:49.906] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:25:49.908] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:25:49.908] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- connect prometheus (10.253.208.63:9090 by user None) [2023-02-21 15:25:49.908] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 15:25:49.918] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:25:49.918] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:25:50.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call prometheus-py_script_display-2.37.1 for prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 [2023-02-21 15:25:50.061] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:25:50.063] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:25:50.064] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send http request method: GET, url: http://10.253.208.63:9090/-/healthy, data: None [2023-02-21 15:25:50.069] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +------------------------------------------------------+ [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | prometheus | [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | http://10.253.208.63:9090 | | | active | [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +---------------------------+------+----------+--------+ [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Call grafana-py_script_restart-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:25:50.070] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - import restart [2023-02-21 15:25:50.072] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - add restart ref count to 1 [2023-02-21 15:25:50.072] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call grafana-py_script_stop-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:25:50.072] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import stop [2023-02-21 15:25:50.073] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add stop ref count to 1 [2023-02-21 15:25:50.074] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Stop grafana [2023-02-21 15:25:50.074] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:25:50.101] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:50.101] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/45563 [2023-02-21 15:25:50.165] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:50.166] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /proc/45563/fd [2023-02-21 15:25:50.236] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:50.237] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 grafana[pid:45563] stopping... [2023-02-21 15:25:50.237] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: kill -9 45563 [2023-02-21 15:25:50.299] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:51.301] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 check whether the port is released [2023-02-21 15:25:51.301] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:51.328] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:51.328] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 grafana is stopped [2023-02-21 15:25:51.379] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub stop ref count to 0 [2023-02-21 15:25:51.379] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export stop [2023-02-21 15:25:51.379] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call grafana-py_script_start-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:25:51.379] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import start [2023-02-21 15:25:51.382] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add start ref count to 1 [2023-02-21 15:25:51.383] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Start grafana [2023-02-21 15:25:51.383] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 generate obd-grafana ini file [2023-02-21 15:25:51.385] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf && rm -fr /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:25:51.410] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:51.410] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmp22ujk57j.ini to /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:25:51.453] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/obd-grafana.ini [2023-02-21 15:25:51.474] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:51.476] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 generate datasources yaml [2023-02-21 15:25:51.478] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- write apiVersion: 1 [2023-02-21 15:25:51.478] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] datasources: [2023-02-21 15:25:51.478] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - name: OB-Prometheus [2023-02-21 15:25:51.478] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] isDefault: 'true' [2023-02-21 15:25:51.478] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] type: prometheus [2023-02-21 15:25:51.478] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] access: proxy [2023-02-21 15:25:51.478] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] editable: 'true' [2023-02-21 15:25:51.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] url: http://10.253.208.63:9090 to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:25:51.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/datasources && rm -fr /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:25:51.535] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:51.535] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmplnfpud10 to /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:25:51.581] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/datasources/sample.yaml [2023-02-21 15:25:51.602] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:51.604] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 generate providers yaml [2023-02-21 15:25:51.606] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- write apiVersion: 1 [2023-02-21 15:25:51.606] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] providers: [2023-02-21 15:25:51.606] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - name: OceanBase Metrics [2023-02-21 15:25:51.606] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] type: file [2023-02-21 15:25:51.606] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] allowUiUpdates: 'true' [2023-02-21 15:25:51.606] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] options: [2023-02-21 15:25:51.606] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] path: /data/obdata/grafana/conf/provisioning/dashboards/templates to admin@10.253.208.63:22: /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:25:51.607] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: mkdir -p /data/obdata/grafana/conf/provisioning/dashboards && rm -fr /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:25:51.664] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:51.664] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send /tmp/tmptl9p3qeb to /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:25:51.709] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - admin@10.253.208.63 execute: chmod 600 /data/obdata/grafana/conf/provisioning/dashboards/sample.yaml [2023-02-21 15:25:51.731] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exited code 0 [2023-02-21 15:25:51.734] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 15:25:51.813] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:51.814] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cd /data/obdata/grafana; bash -c '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid > /data/obdata/grafana/data/log/grafana-console.log 2>&1 &' [2023-02-21 15:25:51.881] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:51.881] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ps -aux | grep -e '/data/obdata/grafana/bin/grafana-server --homepath=/data/obdata/grafana --config=/data/obdata/grafana/conf/obd-grafana.ini --pidfile=/data/obdata/grafana/run/grafana.pid$' | grep -v grep | awk '{print $2}' [2023-02-21 15:25:51.961] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:53.037] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] grafana program health check [2023-02-21 15:25:53.038] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 program health check [2023-02-21 15:25:53.038] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- servers_pid: {<_deploy.ServerConfig object at 0x7f5a69ce1860>: ['47802']} [2023-02-21 15:25:53.038] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0BB8' | awk -F' ' '{print $2}' | uniq [2023-02-21 15:25:53.066] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:53.066] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls -l /proc/47802/fd/ |grep -E 'socket:\[(2104678381)\]' [2023-02-21 15:25:53.130] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:53.131] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: cat /data/obdata/grafana/run/grafana.pid [2023-02-21 15:25:53.192] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 0 [2023-02-21 15:25:53.193] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- 10.253.208.63 grafana[pid: 47802] started [2023-02-21 15:25:53.300] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub start ref count to 0 [2023-02-21 15:25:53.300] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export start [2023-02-21 15:25:53.300] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call grafana-py_script_connect-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:25:53.301] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] Connect to Grafana [2023-02-21 15:25:53.301] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import connect [2023-02-21 15:25:53.303] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add connect ref count to 1 [2023-02-21 15:25:53.303] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- admin@10.253.208.63 execute: ls /data/obdata/grafana/run/.grafana [2023-02-21 15:25:53.328] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- exited code 2, error output: [2023-02-21 15:25:53.328] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ls: 无法访问/data/obdata/grafana/run/.grafana: 没有那个文件或目录 [2023-02-21 15:25:53.328] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] [2023-02-21 15:25:53.328] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- connect grafana (10.253.208.63:3000 by user admin) [2023-02-21 15:25:53.328] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub connect ref count to 0 [2023-02-21 15:25:53.328] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export connect [2023-02-21 15:25:53.432] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] -- Call grafana-py_script_display-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2023-02-21 15:25:53.432] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- import display [2023-02-21 15:25:53.433] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- add display ref count to 1 [2023-02-21 15:25:53.433] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- type: [2023-02-21 15:25:53.433] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- send http request method: GET, url: http://10.253.208.63:3000/api/dashboards/tags, data: None [2023-02-21 15:25:53.478] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] ---- request grafana failed: b'{"message":"invalid username or password"}' [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +---------------------------------------------------------------------+ [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | grafana | [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +---------------------------------------+-------+----------+----------+ [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | url | user | password | status | [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +---------------------------------------+-------+----------+----------+ [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] | http://10.253.208.63:3000/d/oceanbase | admin | admin | inactive | [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] +---------------------------------------+-------+----------+----------+ [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- sub display ref count to 0 [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] --- export display [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - sub restart ref count to 0 [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - export restart [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - Set observer deploy status to running [2023-02-21 15:25:53.479] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/observer/.data [2023-02-21 15:25:53.486] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [INFO] observer restart [2023-02-21 15:25:53.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 4 [2023-02-21 15:25:53.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2023-02-21 15:25:53.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2023-02-21 15:25:53.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2023-02-21 15:25:53.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2023-02-21 15:25:53.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2023-02-21 15:25:53.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_observer release, count 0 [2023-02-21 15:25:53.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_observer [2023-02-21 15:25:53.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2023-02-21 15:25:53.487] [d623bdbc-b1b8-11ed-8aa4-fa163e9e21e4] [DEBUG] - unlock /home/admin/.obd/lock/global