【OBProxy】
[2024-08-15 01:26:48.699] [DEBUG] - Get deploy config
[2024-08-15 01:26:48.700] [INFO] Search plugins
[2024-08-15 01:26:48.700] [DEBUG] - Searching start_check plugin for components ...
[2024-08-15 01:26:48.700] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-1a03d87ec62c1880415d1911beb10e35a872d416
[2024-08-15 01:26:48.701] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.2.1.4 for oceanbase-ce-4.2.1.7
[2024-08-15 01:26:48.701] [DEBUG] - Searching start_check plugin for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.701] [DEBUG] - Found for obproxy-ce-py_script_start_check-4.2.3 for obproxy-ce-4.3.1.0
[2024-08-15 01:26:48.702] [DEBUG] - Searching start_check plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545
[2024-08-15 01:26:48.702] [DEBUG] - Found for obagent-py_script_start_check-1.3.0 for obagent-4.2.2
[2024-08-15 01:26:48.702] [DEBUG] - Searching create_tenant plugin for components ...
[2024-08-15 01:26:48.702] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-1a03d87ec62c1880415d1911beb10e35a872d416
[2024-08-15 01:26:48.703] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.2.0.0 for oceanbase-ce-4.2.1.7
[2024-08-15 01:26:48.703] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.703] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.3.1.0
[2024-08-15 01:26:48.703] [DEBUG] - Searching create_tenant plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545
[2024-08-15 01:26:48.704] [DEBUG] - No such create_tenant plugin for obagent-4.2.2
[2024-08-15 01:26:48.704] [DEBUG] - Searching tenant_optimize plugin for components ...
[2024-08-15 01:26:48.704] [DEBUG] - Searching tenant_optimize plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-1a03d87ec62c1880415d1911beb10e35a872d416
[2024-08-15 01:26:48.704] [DEBUG] - No such tenant_optimize plugin for oceanbase-ce-4.2.1.7
[2024-08-15 01:26:48.704] [DEBUG] - Searching tenant_optimize plugin for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.705] [DEBUG] - No such tenant_optimize plugin for obproxy-ce-4.3.1.0
[2024-08-15 01:26:48.705] [DEBUG] - Searching tenant_optimize plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545
[2024-08-15 01:26:48.705] [DEBUG] - No such tenant_optimize plugin for obagent-4.2.2
[2024-08-15 01:26:48.705] [DEBUG] - Searching start plugin for components ...
[2024-08-15 01:26:48.705] [DEBUG] - Searching start plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-1a03d87ec62c1880415d1911beb10e35a872d416
[2024-08-15 01:26:48.706] [DEBUG] - Found for oceanbase-ce-py_script_start-4.2.1.4 for oceanbase-ce-4.2.1.7
[2024-08-15 01:26:48.706] [DEBUG] - Searching start plugin for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.706] [DEBUG] - Found for obproxy-ce-py_script_start-4.2.3 for obproxy-ce-4.3.1.0
[2024-08-15 01:26:48.706] [DEBUG] - Searching start plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545
[2024-08-15 01:26:48.707] [DEBUG] - Found for obagent-py_script_start-1.3.0 for obagent-4.2.2
[2024-08-15 01:26:48.707] [DEBUG] - Searching connect plugin for components ...
[2024-08-15 01:26:48.707] [DEBUG] - Searching connect plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-1a03d87ec62c1880415d1911beb10e35a872d416
[2024-08-15 01:26:48.707] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.1.4 for oceanbase-ce-4.2.1.7
[2024-08-15 01:26:48.708] [DEBUG] - Searching connect plugin for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.708] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.3.1.0
[2024-08-15 01:26:48.708] [DEBUG] - Searching connect plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545
[2024-08-15 01:26:48.708] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-4.2.2
[2024-08-15 01:26:48.708] [DEBUG] - Searching bootstrap plugin for components ...
[2024-08-15 01:26:48.708] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-1a03d87ec62c1880415d1911beb10e35a872d416
[2024-08-15 01:26:48.709] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.2.1.4 for oceanbase-ce-4.2.1.7
[2024-08-15 01:26:48.709] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.709] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.3.1.0
[2024-08-15 01:26:48.710] [DEBUG] - Searching bootstrap plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545
[2024-08-15 01:26:48.710] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-4.2.2
[2024-08-15 01:26:48.710] [DEBUG] - Searching display plugin for components ...
[2024-08-15 01:26:48.710] [DEBUG] - Searching display plugin for oceanbase-ce-4.2.1.7-107000162024060611.el7-1a03d87ec62c1880415d1911beb10e35a872d416
[2024-08-15 01:26:48.710] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.1.7
[2024-08-15 01:26:48.711] [DEBUG] - Searching display plugin for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.711] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.3.1.0
[2024-08-15 01:26:48.711] [DEBUG] - Searching display plugin for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545
[2024-08-15 01:26:48.711] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-4.2.2
[2024-08-15 01:26:48.712] [INFO] Load cluster param plugin
[2024-08-15 01:26:48.712] [DEBUG] - Get local repository oceanbase-ce-4.2.1.7-1a03d87ec62c1880415d1911beb10e35a872d416
[2024-08-15 01:26:48.712] [DEBUG] - Get local repository obproxy-ce-4.3.1.0-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.712] [DEBUG] - Get local repository obagent-4.2.2-8a5c3b8c55defe409d1e72b7efd13c5e41549545
[2024-08-15 01:26:48.712] [DEBUG] - Searching param plugin for components ...
[2024-08-15 01:26:48.712] [DEBUG] - Search param plugin for oceanbase-ce
[2024-08-15 01:26:48.713] [DEBUG] - Found for oceanbase-ce-param-4.2.1.4 for oceanbase-ce-4.2.1.7
[2024-08-15 01:26:48.713] [DEBUG] - Applying oceanbase-ce-param-4.2.1.4 for oceanbase-ce-4.2.1.7-107000162024060611.el7-1a03d87ec62c1880415d1911beb10e35a872d416
[2024-08-15 01:26:48.714] [DEBUG] - Search param plugin for obproxy-ce
[2024-08-15 01:26:48.714] [DEBUG] - Found for obproxy-ce-param-4.2.3 for obproxy-ce-4.3.1.0
[2024-08-15 01:26:48.714] [DEBUG] - Applying obproxy-ce-param-4.2.3 for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.714] [DEBUG] - Search param plugin for obagent
[2024-08-15 01:26:48.715] [DEBUG] - Found for obagent-param-1.3.0 for obagent-4.2.2
[2024-08-15 01:26:48.715] [DEBUG] - Applying obagent-param-1.3.0 for obagent-4.2.2-100000042024011120.el7-8a5c3b8c55defe409d1e72b7efd13c5e41549545
[2024-08-15 01:26:48.715] [DEBUG] - Call obproxy-ce-py_script_start_check-4.2.3 for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.716] [INFO] Check before start obproxy
[2024-08-15 01:26:48.717] [DEBUG] -- root@112.24.96.41 execute: cat /root/data/obproxy/run/obproxy-112.24.96.41-62883.pid 
[2024-08-15 01:26:48.747] [DEBUG] -- exited code 1, error output:
[2024-08-15 01:26:48.748] [DEBUG] cat: /root/data/obproxy/run/obproxy-112.24.96.41-62883.pid: No such file or directory
[2024-08-15 01:26:48.748] [DEBUG] 
[2024-08-15 01:26:48.748] [DEBUG] -- 112.24.96.41 port check
[2024-08-15 01:26:48.749] [DEBUG] -- root@112.24.96.41 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':F5A3' | awk -F' ' '{print $3}' | uniq 
[2024-08-15 01:26:48.806] [DEBUG] -- exited code 0
[2024-08-15 01:26:48.807] [DEBUG] -- root@112.24.96.41 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{if($4=="0A") print $2,$4,$10}' | grep ':F5A4' | awk -F' ' '{print $3}' | uniq 
[2024-08-15 01:26:48.867] [DEBUG] -- exited code 0
[2024-08-15 01:26:48.867] [DEBUG] - plugin obproxy-ce-py_script_start_check-4.2.3 result: True
[2024-08-15 01:26:48.867] [DEBUG] - Call obproxy-ce-py_script_start-4.2.3 for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:48.868] [DEBUG] - import start
[2024-08-15 01:26:48.872] [DEBUG] - add start ref count to 1
[2024-08-15 01:26:48.876] [INFO] Start obproxy
[2024-08-15 01:26:48.876] [DEBUG] -- root@112.24.96.41 execute: ls /root/data/obproxy/etc/obproxy_config.bin 
[2024-08-15 01:26:48.915] [DEBUG] -- exited code 2, error output:
[2024-08-15 01:26:48.916] [DEBUG] ls: cannot access '/root/data/obproxy/etc/obproxy_config.bin': No such file or directory
[2024-08-15 01:26:48.916] [DEBUG] 
[2024-08-15 01:26:48.916] [DEBUG] -- 112.24.96.41 port check
[2024-08-15 01:26:48.916] [DEBUG] -- root@112.24.96.41 execute: cat /root/data/obproxy/run/obproxy-112.24.96.41-62883.pid 
[2024-08-15 01:26:48.963] [DEBUG] -- exited code 1, error output:
[2024-08-15 01:26:48.963] [DEBUG] cat: /root/data/obproxy/run/obproxy-112.24.96.41-62883.pid: No such file or directory
[2024-08-15 01:26:48.963] [DEBUG] 
[2024-08-15 01:26:48.964] [DEBUG] -- starting 112.24.96.41 obproxy
[2024-08-15 01:26:48.964] [DEBUG] -- root@112.24.96.41 set env LD_LIBRARY_PATH to '/root/data/obproxy/lib:'
[2024-08-15 01:26:48.964] [DEBUG] -- root@112.24.96.41 execute: cd /root/data/obproxy; /root/data/obproxy/bin/obproxy -o client_session_id_version=2,proxy_id=7765,obproxy_sys_password='adc9006a1869fc575de5b49994710a43f0dec0b2',enable_strict_kernel_release=False,skip_proxy_sys_private_check=True,enable_cluster_checkout=False,proxy_mem_limited='500M',proxy_id=7765,client_session_id_version=2 --listen_port 62883 --prometheus_listen_port 62884 --rs_list '112.24.96.41:62881' --cluster_name 'data' 
[2024-08-15 01:26:49.029] [DEBUG] -- exited code 0
[2024-08-15 01:26:49.029] [DEBUG] -- root@112.24.96.41 set env LD_LIBRARY_PATH to ''
[2024-08-15 01:26:49.030] [DEBUG] -- root@112.24.96.41 execute: ps -aux | grep -e '/root/data/obproxy/bin/obproxy -o client_session_id_version=2,proxy_id=7765,obproxy_sys_password=adc9006a1869fc575de5b49994710a43f0dec0b2,enable_strict_kernel_release=False,skip_proxy_sys_private_check=True,enable_cluster_checkout=False,proxy_mem_limited=500M,proxy_id=7765,client_session_id_version=2 --listen_port 62883 --prometheus_listen_port 62884 --rs_list 112.24.96.41:62881 --cluster_name data$' | grep -v grep | awk '{print $2}' > /root/data/obproxy/run/obproxy-112.24.96.41-62883.pid 
[2024-08-15 01:26:49.106] [DEBUG] -- exited code 0
[2024-08-15 01:26:49.108] [INFO] obproxy program health check
[2024-08-15 01:26:49.108] [DEBUG] -- 112.24.96.41 program health check
[2024-08-15 01:26:49.108] [DEBUG] -- root@112.24.96.41 execute: cat /root/data/obproxy/run/obproxy-112.24.96.41-62883.pid 
[2024-08-15 01:26:49.159] [DEBUG] -- exited code 0
[2024-08-15 01:26:49.160] [DEBUG] -- root@112.24.96.41 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:F5A3' | awk -F' ' '{print $2}' | uniq 
[2024-08-15 01:26:49.222] [DEBUG] -- exited code 0
[2024-08-15 01:26:49.223] [DEBUG] -- 3968685
[2024-08-15 01:26:49.223] [DEBUG] 
[2024-08-15 01:26:49.223] [DEBUG] -- root@112.24.96.41 execute: ls -l /proc/630411/fd/ |grep -E 'socket:\[(3968685)\]' 
[2024-08-15 01:26:49.277] [DEBUG] -- exited code 0
[2024-08-15 01:26:49.278] [DEBUG] -- root@112.24.96.41 execute: pid=`cat /root/data/obproxy/run/obproxyd-112.24.96.41-62883.pid` && ls /proc/$pid 
[2024-08-15 01:26:49.331] [DEBUG] -- exited code 1, error output:
[2024-08-15 01:26:49.331] [DEBUG] cat: /root/data/obproxy/run/obproxyd-112.24.96.41-62883.pid: No such file or directory
[2024-08-15 01:26:49.331] [DEBUG] 
[2024-08-15 01:26:49.332] [DEBUG] -- root@112.24.96.41 execute: echo 630411 > /root/data/obproxy/run/obproxy-112.24.96.41-62883.pid 
[2024-08-15 01:26:49.382] [DEBUG] -- exited code 0
[2024-08-15 01:26:49.439] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT
[2024-08-15 01:26:49.439] [DEBUG] -- root@112.24.96.41 execute: mkdir -p /root/data/obproxy && rm -fr /root/data/obproxy/obproxyd.sh 
[2024-08-15 01:26:49.446] [DEBUG] -- exited code 0
[2024-08-15 01:26:49.447] [DEBUG] -- send /root/.obd/plugins/obproxy-ce/4.2.3/obproxyd.sh to /root/data/obproxy/obproxyd.sh
[2024-08-15 01:26:49.492] [DEBUG] - root@112.24.96.41 execute: chmod 644 /root/data/obproxy/obproxyd.sh 
[2024-08-15 01:26:49.498] [DEBUG] - exited code 0
[2024-08-15 01:26:49.499] [DEBUG] -- root@112.24.96.41 execute: bash /root/data/obproxy/obproxyd.sh /root/data/obproxy 112.24.96.41 62883 
[2024-08-15 01:26:49.547] [DEBUG] -- exited code 0
[2024-08-15 01:26:50.549] [DEBUG] -- 112.24.96.41 program health check
[2024-08-15 01:26:50.549] [DEBUG] -- root@112.24.96.41 execute: cat /root/data/obproxy/run/obproxy-112.24.96.41-62883.pid 
[2024-08-15 01:26:50.556] [DEBUG] -- exited code 0
[2024-08-15 01:26:50.556] [DEBUG] -- root@112.24.96.41 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:F5A3' | awk -F' ' '{print $2}' | uniq 
[2024-08-15 01:26:50.615] [DEBUG] -- exited code 0
[2024-08-15 01:26:50.616] [DEBUG] -- failed to start 112.24.96.41 obproxy, remaining retries: 298
[2024-08-15 01:26:51.617] [DEBUG] -- 112.24.96.41 program health check
[2024-08-15 01:26:51.617] [DEBUG] -- root@112.24.96.41 execute: cat /root/data/obproxy/run/obproxy-112.24.96.41-62883.pid 
[2024-08-15 01:26:51.623] [DEBUG] -- exited code 0
[2024-08-15 01:26:51.624] [DEBUG] -- root@112.24.96.41 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:F5A3' | awk -F' ' '{print $2}' | uniq 
[2024-08-15 01:26:51.682] [DEBUG] -- exited code 0
[2024-08-15 01:26:51.683] [DEBUG] -- 3952395
[2024-08-15 01:26:51.683] [DEBUG] 
[2024-08-15 01:26:51.683] [DEBUG] -- root@112.24.96.41 execute: ls -l /proc/630503/fd/ |grep -E 'socket:\[(3952395)\]' 
[2024-08-15 01:26:51.733] [DEBUG] -- exited code 0
[2024-08-15 01:26:51.733] [DEBUG] -- root@112.24.96.41 execute: pid=`cat /root/data/obproxy/run/obproxyd-112.24.96.41-62883.pid` && ls /proc/$pid 
[2024-08-15 01:26:51.788] [DEBUG] -- exited code 0
[2024-08-15 01:26:51.788] [DEBUG] -- 112.24.96.41 obproxy[pid: 630503] started
[2024-08-15 01:26:51.789] [DEBUG] - sub start ref count to 0
[2024-08-15 01:26:51.789] [DEBUG] - export start
[2024-08-15 01:26:51.789] [DEBUG] - plugin obproxy-ce-py_script_start-4.2.3 result: True
[2024-08-15 01:26:51.789] [DEBUG] - Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.3.1.0-4.el7-d6c84251ef2a2afd95dcabfc36c5896678d2b1c4
[2024-08-15 01:26:51.789] [DEBUG] - import connect
[2024-08-15 01:26:51.793] [DEBUG] - add connect ref count to 1
[2024-08-15 01:26:51.793] [INFO] Connect to obproxy
[2024-08-15 01:26:51.795] [DEBUG] -- connect 112.24.96.41 -P62883 -uroot@proxysys -ppHidrOw5EL
[2024-08-15 01:27:04.809] [DEBUG] -- connect 112.24.96.41 -P62883 -uroot@proxysys -p
[2024-08-15 01:27:17.819] [DEBUG] -- connect 112.24.96.41 -P62883 -uroot@proxysys -ppHidrOw5EL
[2024-08-15 01:27:30.830] [DEBUG] -- connect 112.24.96.41 -P62883 -uroot@proxysys -p
[2024-08-15 01:27:43.841] [DEBUG] -- connect 112.24.96.41 -P62883 -uroot@proxysys -ppHidrOw5EL
[2024-08-15 01:27:56.851] [DEBUG] -- connect 112.24.96.41 -P62883 -uroot@proxysys -p
[2024-08-15 01:28:09.865] [DEBUG] -- connect 112.24.96.41 -P62883 -uroot@proxysys -ppHidrOw5EL
[2024-08-15 01:28:22.873] [DEBUG] -- connect 112.24.96.41 -P62883 -uroot@proxysys -p
[2024-08-15 01:28:35.885] [DEBUG] -- connect 112.24.96.41 -P62883 -uroot@proxysys -ppHidrOw5EL
[2024-08-15 01:28:48.892] [DEBUG] -- connect 112.24.96.41 -P62883 -uroot@proxysys -p
[2024-08-15 01:29:01.902] [ERROR] OBD-1006: Failed to connect to obproxy-ce
[2024-08-15 01:29:01.902] [DEBUG] - sub connect ref count to 0
[2024-08-15 01:29:01.902] [DEBUG] - export connect
[2024-08-15 01:29:01.902] [DEBUG] - plugin obproxy-ce-py_script_connect-3.1.0 result: False