【 使用环境 】测试环境
【 OB or 其他组件 】obd
【 使用版本 】4.1.0.0
【问题描述】提示OBProxy失败、OCP Express 失败
【复现路径】问题出现前后相关操作
就最小化,自动部署,其他啥都是默认的
【问题现象及影响】
OBProxy 检测启动失败
可是我看到进程有启动啊
[2023-06-15 15:19:23.706] [DEBUG] - Get deploy config
[2023-06-15 15:19:23.707] [INFO] Search plugins
[2023-06-15 15:19:23.707] [DEBUG] - Searching start_check plugin for components ...
[2023-06-15 15:19:23.707] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:23.707] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:23.707] [DEBUG] - Searching start_check plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:23.707] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:23.707] [DEBUG] - Searching start_check plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:23.707] [DEBUG] - Found for obagent-py_script_start_check-1.3.0 for obagent-1.3.1
[2023-06-15 15:19:23.708] [DEBUG] - Searching start_check plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:23.708] [DEBUG] - Found for ocp-express-py_script_start_check-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:23.708] [DEBUG] - Searching create_tenant plugin for components ...
[2023-06-15 15:19:23.708] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:23.708] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.0.0.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:23.708] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:23.708] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.1.0.0
[2023-06-15 15:19:23.708] [DEBUG] - Searching create_tenant plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:23.708] [DEBUG] - No such create_tenant plugin for obagent-1.3.1
[2023-06-15 15:19:23.708] [DEBUG] - Searching create_tenant plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:23.708] [DEBUG] - No such create_tenant plugin for ocp-express-1.0.1
[2023-06-15 15:19:23.709] [DEBUG] - Searching start plugin for components ...
[2023-06-15 15:19:23.709] [DEBUG] - Searching start plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:23.709] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:23.709] [DEBUG] - Searching start plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:23.709] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:23.709] [DEBUG] - Searching start plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:23.709] [DEBUG] - Found for obagent-py_script_start-1.3.0 for obagent-1.3.1
[2023-06-15 15:19:23.709] [DEBUG] - Searching start plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:23.709] [DEBUG] - Found for ocp-express-py_script_start-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:23.709] [DEBUG] - Searching connect plugin for components ...
[2023-06-15 15:19:23.709] [DEBUG] - Searching connect plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:23.710] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:23.710] [DEBUG] - Searching connect plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:23.710] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:23.710] [DEBUG] - Searching connect plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:23.710] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-1.3.1
[2023-06-15 15:19:23.710] [DEBUG] - Searching connect plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:23.710] [DEBUG] - Found for ocp-express-py_script_connect-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:23.710] [DEBUG] - Searching bootstrap plugin for components ...
[2023-06-15 15:19:23.710] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:23.710] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:23.710] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:23.711] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:23.711] [DEBUG] - Searching bootstrap plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:23.711] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.3.1
[2023-06-15 15:19:23.711] [DEBUG] - Searching bootstrap plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:23.711] [DEBUG] - Found for ocp-express-py_script_bootstrap-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:23.711] [DEBUG] - Searching display plugin for components ...
[2023-06-15 15:19:23.711] [DEBUG] - Searching display plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:23.711] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:23.711] [DEBUG] - Searching display plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:23.711] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:23.711] [DEBUG] - Searching display plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:23.712] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-1.3.1
[2023-06-15 15:19:23.712] [DEBUG] - Searching display plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:23.712] [DEBUG] - Found for ocp-express-py_script_display-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:23.712] [INFO] Load cluster param plugin
[2023-06-15 15:19:23.712] [DEBUG] - Searching param plugin for components ...
[2023-06-15 15:19:23.712] [DEBUG] - Search param plugin for oceanbase-ce
[2023-06-15 15:19:23.712] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:23.713] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:23.713] [DEBUG] - Search param plugin for obproxy-ce
[2023-06-15 15:19:23.713] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:23.713] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:23.713] [DEBUG] - Search param plugin for obagent
[2023-06-15 15:19:23.713] [DEBUG] - Found for obagent-param-1.3.0 for obagent-1.3.1
[2023-06-15 15:19:23.713] [DEBUG] - Applying obagent-param-1.3.0 for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:23.713] [DEBUG] - Search param plugin for ocp-express
[2023-06-15 15:19:23.714] [DEBUG] - Found for ocp-express-param-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:23.714] [DEBUG] - Applying ocp-express-param-1.0.1 for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:23.714] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:23.714] [INFO] Check before start obproxy
[2023-06-15 15:19:23.714] [DEBUG] -- root@10.210.76.6 execute: cat /root/xzcoceanbase/obproxy/run/obproxy-10.210.76.6-2883.pid
[2023-06-15 15:19:23.735] [DEBUG] -- exited code 1, error output:
[2023-06-15 15:19:23.736] [DEBUG] cat: /root/xzcoceanbase/obproxy/run/obproxy-10.210.76.6-2883.pid: No such file or directory
[2023-06-15 15:19:23.736] [DEBUG]
[2023-06-15 15:19:23.736] [DEBUG] -- 10.210.76.6 port check
[2023-06-15 15:19:23.736] [DEBUG] -- root@10.210.76.6 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq
[2023-06-15 15:19:23.804] [DEBUG] -- exited code 0
[2023-06-15 15:19:23.804] [DEBUG] -- root@10.210.76.6 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq
[2023-06-15 15:19:23.870] [DEBUG] -- exited code 0
[2023-06-15 15:19:23.871] [DEBUG] - Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:23.871] [DEBUG] - import start
[2023-06-15 15:19:23.874] [DEBUG] - add start ref count to 1
[2023-06-15 15:19:23.876] [INFO] Start obproxy
[2023-06-15 15:19:23.876] [DEBUG] -- root@10.210.76.6 execute: ls /root/xzcoceanbase/obproxy/etc/obproxy_config.bin
[2023-06-15 15:19:23.930] [DEBUG] -- exited code 2, error output:
[2023-06-15 15:19:23.930] [DEBUG] ls: cannot access /root/xzcoceanbase/obproxy/etc/obproxy_config.bin: No such file or directory
[2023-06-15 15:19:23.930] [DEBUG]
[2023-06-15 15:19:23.931] [DEBUG] -- 10.210.76.6 port check
[2023-06-15 15:19:23.931] [DEBUG] -- root@10.210.76.6 execute: cat /root/xzcoceanbase/obproxy/run/obproxy-10.210.76.6-2883.pid
[2023-06-15 15:19:23.990] [DEBUG] -- exited code 1, error output:
[2023-06-15 15:19:23.990] [DEBUG] cat: /root/xzcoceanbase/obproxy/run/obproxy-10.210.76.6-2883.pid: No such file or directory
[2023-06-15 15:19:23.990] [DEBUG]
[2023-06-15 15:19:23.991] [DEBUG] -- starting 10.210.76.6 obproxy
[2023-06-15 15:19:23.991] [DEBUG] -- root@10.210.76.6 set env LD_LIBRARY_PATH to '/root/xzcoceanbase/obproxy/lib:'
[2023-06-15 15:19:23.991] [DEBUG] -- root@10.210.76.6 execute: cd /root/xzcoceanbase/obproxy; /root/xzcoceanbase/obproxy/bin/obproxy -o obproxy_sys_password='8c2b4886c4bb98c5a4eac2e86053165bcb9226b9',enable_strict_kernel_release=False,skip_proxy_sys_private_check=True,enable_cluster_checkout=False,proxy_mem_limited='500M' --listen_port 2883 --prometheus_listen_port 2884 --rs_list '10.210.76.6:2881' --cluster_name 'xzcoceanbase'
[2023-06-15 15:19:24.081] [DEBUG] -- exited code 0
[2023-06-15 15:19:24.082] [DEBUG] -- root@10.210.76.6 set env LD_LIBRARY_PATH to ''
[2023-06-15 15:19:24.082] [DEBUG] -- root@10.210.76.6 execute: ps -aux | grep -e '/root/xzcoceanbase/obproxy/bin/obproxy -o obproxy_sys_password=8c2b4886c4bb98c5a4eac2e86053165bcb9226b9,enable_strict_kernel_release=False,skip_proxy_sys_private_check=True,enable_cluster_checkout=False,proxy_mem_limited=500M --listen_port 2883 --prometheus_listen_port 2884 --rs_list 10.210.76.6:2881 --cluster_name xzcoceanbase$' | grep -v grep | awk '{print $2}' > /root/xzcoceanbase/obproxy/run/obproxy-10.210.76.6-2883.pid
[2023-06-15 15:19:24.160] [DEBUG] -- exited code 0
[2023-06-15 15:19:24.161] [INFO] obproxy program health check
:::
[2023-06-15 15:19:43.750] [DEBUG] -- 10.210.76.6 program health check
[2023-06-15 15:19:43.750] [DEBUG] -- root@10.210.76.6 execute: cat /root/xzcoceanbase/obproxy/run/obproxy-10.210.76.6-2883.pid
[2023-06-15 15:19:43.772] [DEBUG] -- exited code 0
[2023-06-15 15:19:43.772] [DEBUG] -- root@10.210.76.6 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq
[2023-06-15 15:19:43.836] [DEBUG] -- exited code 0
[2023-06-15 15:19:43.837] [DEBUG] -- failed to start 10.210.76.6 obproxy, remaining retries: 1
[2023-06-15 15:19:44.838] [DEBUG] -- 10.210.76.6 program health check
[2023-06-15 15:19:44.838] [DEBUG] -- root@10.210.76.6 execute: cat /root/xzcoceanbase/obproxy/run/obproxy-10.210.76.6-2883.pid
[2023-06-15 15:19:44.857] [DEBUG] -- exited code 0
[2023-06-15 15:19:44.858] [DEBUG] -- root@10.210.76.6 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq
[2023-06-15 15:19:44.920] [DEBUG] -- exited code 0
[2023-06-15 15:19:44.921] [DEBUG] -- failed to start 10.210.76.6 obproxy, remaining retries: 0
[2023-06-15 15:19:44.921] [WARNING] failed to start 10.210.76.6 obproxy
[2023-06-15 15:19:44.921] [DEBUG] - sub start ref count to 0
[2023-06-15 15:19:44.921] [DEBUG] - export start
[2023-06-15 15:19:44.921] [ERROR] obproxy-ce start failed
OCP Express 提示启动失败
[2023-06-15 15:19:48.597] [DEBUG] - Get deploy config
[2023-06-15 15:19:48.597] [INFO] Search plugins
[2023-06-15 15:19:48.597] [DEBUG] - Searching start_check plugin for components ...
[2023-06-15 15:19:48.597] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:48.598] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.0.0.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:48.598] [DEBUG] - Searching start_check plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:48.598] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:48.598] [DEBUG] - Searching start_check plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:48.598] [DEBUG] - Found for obagent-py_script_start_check-1.3.0 for obagent-1.3.1
[2023-06-15 15:19:48.598] [DEBUG] - Searching start_check plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:48.598] [DEBUG] - Found for ocp-express-py_script_start_check-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:48.598] [DEBUG] - Searching create_tenant plugin for components ...
[2023-06-15 15:19:48.598] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:48.599] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.0.0.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:48.599] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:48.599] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.1.0.0
[2023-06-15 15:19:48.599] [DEBUG] - Searching create_tenant plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:48.599] [DEBUG] - No such create_tenant plugin for obagent-1.3.1
[2023-06-15 15:19:48.599] [DEBUG] - Searching create_tenant plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:48.599] [DEBUG] - No such create_tenant plugin for ocp-express-1.0.1
[2023-06-15 15:19:48.599] [DEBUG] - Searching start plugin for components ...
[2023-06-15 15:19:48.599] [DEBUG] - Searching start plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:48.599] [DEBUG] - Found for oceanbase-ce-py_script_start-4.0.0.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:48.600] [DEBUG] - Searching start plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:48.600] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:48.600] [DEBUG] - Searching start plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:48.600] [DEBUG] - Found for obagent-py_script_start-1.3.0 for obagent-1.3.1
[2023-06-15 15:19:48.600] [DEBUG] - Searching start plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:48.600] [DEBUG] - Found for ocp-express-py_script_start-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:48.600] [DEBUG] - Searching connect plugin for components ...
[2023-06-15 15:19:48.600] [DEBUG] - Searching connect plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:48.600] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:48.600] [DEBUG] - Searching connect plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:48.601] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:48.601] [DEBUG] - Searching connect plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:48.601] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-1.3.1
[2023-06-15 15:19:48.601] [DEBUG] - Searching connect plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:48.601] [DEBUG] - Found for ocp-express-py_script_connect-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:48.601] [DEBUG] - Searching bootstrap plugin for components ...
[2023-06-15 15:19:48.601] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:48.601] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.0.0.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:48.601] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:48.601] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:48.601] [DEBUG] - Searching bootstrap plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:48.602] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-1.3.1
[2023-06-15 15:19:48.602] [DEBUG] - Searching bootstrap plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:48.602] [DEBUG] - Found for ocp-express-py_script_bootstrap-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:48.602] [DEBUG] - Searching display plugin for components ...
[2023-06-15 15:19:48.602] [DEBUG] - Searching display plugin for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:48.602] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:48.602] [DEBUG] - Searching display plugin for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:48.602] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:48.602] [DEBUG] - Searching display plugin for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:48.602] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-1.3.1
[2023-06-15 15:19:48.603] [DEBUG] - Searching display plugin for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:48.603] [DEBUG] - Found for ocp-express-py_script_display-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:48.604] [INFO] Load cluster param plugin
[2023-06-15 15:19:48.604] [DEBUG] - Searching param plugin for components ...
[2023-06-15 15:19:48.604] [DEBUG] - Search param plugin for oceanbase-ce
[2023-06-15 15:19:48.604] [DEBUG] - Found for oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.1.0.0
[2023-06-15 15:19:48.604] [DEBUG] - Applying oceanbase-ce-param-4.0.0.0 for oceanbase-ce-4.1.0.0-101010022023051821.el7-21271468e0dee7aaf3d4eff4c4bf5e07421ef6fe
[2023-06-15 15:19:48.605] [DEBUG] - Search param plugin for obproxy-ce
[2023-06-15 15:19:48.605] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.1.0.0
[2023-06-15 15:19:48.605] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.1.0.0-7.el7-2a9d9bf67f179dcca2a8c9e7c77373d94e7e2abe
[2023-06-15 15:19:48.605] [DEBUG] - Search param plugin for obagent
[2023-06-15 15:19:48.606] [DEBUG] - Found for obagent-param-1.3.0 for obagent-1.3.1
[2023-06-15 15:19:48.606] [DEBUG] - Applying obagent-param-1.3.0 for obagent-1.3.1-5.el7-ccfe93272a79ab1073e76f00580386c9c52e8324
[2023-06-15 15:19:48.606] [DEBUG] - Search param plugin for ocp-express
[2023-06-15 15:19:48.606] [DEBUG] - Found for ocp-express-param-1.0.1 for ocp-express-1.0.1
[2023-06-15 15:19:48.606] [DEBUG] - Applying ocp-express-param-1.0.1 for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:48.606] [DEBUG] - Call ocp-express-py_script_start_check-1.0.1 for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:48.607] [INFO] Check before start ocp-express
[2023-06-15 15:19:48.611] [DEBUG] -- root@10.210.76.6 execute: cat /root/xzcoceanbase/ocpexpress/run/ocp-express.pid
[2023-06-15 15:19:48.630] [DEBUG] -- exited code 1, error output:
[2023-06-15 15:19:48.630] [DEBUG] cat: /root/xzcoceanbase/ocpexpress/run/ocp-express.pid: No such file or directory
[2023-06-15 15:19:48.630] [DEBUG]
[2023-06-15 15:19:48.631] [DEBUG] -- root@10.210.76.6 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq
[2023-06-15 15:19:48.694] [DEBUG] -- exited code 0
[2023-06-15 15:19:48.694] [DEBUG] -- root@10.210.76.6 execute: java -version
[2023-06-15 15:19:48.827] [DEBUG] -- exited code 0
[2023-06-15 15:19:48.828] [DEBUG] -- root@10.210.76.6 execute: cat /proc/meminfo
[2023-06-15 15:19:48.888] [DEBUG] -- exited code 0
[2023-06-15 15:19:48.889] [DEBUG] -- root@10.210.76.6 execute: df --block-size=1024
[2023-06-15 15:19:48.948] [DEBUG] -- exited code 0
[2023-06-15 15:19:48.948] [DEBUG] -- get disk info for path /dev, total: 16751013888 avail: 16751013888
[2023-06-15 15:19:48.949] [DEBUG] -- get disk info for path /dev/shm, total: 16783155200 avail: 16783155200
[2023-06-15 15:19:48.949] [DEBUG] -- get disk info for path /run, total: 16783155200 avail: 15096225792
[2023-06-15 15:19:48.949] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 16783155200 avail: 16783155200
[2023-06-15 15:19:48.949] [DEBUG] -- get disk info for path /, total: 105174716416 avail: 39144914944
[2023-06-15 15:19:48.949] [DEBUG] -- get disk info for path /boot, total: 499337216 avail: 310552576
[2023-06-15 15:19:48.949] [DEBUG] -- get disk info for path /run/user/0, total: 3356635136 avail: 3356635136
[2023-06-15 15:19:48.949] [DEBUG] -- get disk info for path /data2, total: 316933144576 avail: 198519967744
[2023-06-15 15:19:48.949] [DEBUG] -- root@10.210.76.6 execute: df --block-size=1024 /root/xzcoceanbase/ocpexpress/log
[2023-06-15 15:19:49.008] [DEBUG] -- exited code 0
[2023-06-15 15:19:49.009] [DEBUG] -- get disk info for path /, total: 105174716416 avail: 39144898560
[2023-06-15 15:19:49.009] [DEBUG] - Call ocp-express-py_script_start-1.0.1 for ocp-express-1.0.1-100000072023051917.el7-59eb8062858271a23080c824c98a72f9e5896235
[2023-06-15 15:19:49.009] [DEBUG] - import start
[2023-06-15 15:19:49.097] [DEBUG] - add start ref count to 1
[2023-06-15 15:19:49.111] [INFO] Start ocp-express
[2023-06-15 15:19:49.112] [DEBUG] -- root@10.210.76.6 execute: cat /root/xzcoceanbase/ocpexpress/run/ocp-express.pid
[2023-06-15 15:19:49.129] [DEBUG] -- exited code 1, error output:
[2023-06-15 15:19:49.130] [DEBUG] cat: /root/xzcoceanbase/ocpexpress/run/ocp-express.pid: No such file or directory
[2023-06-15 15:19:49.130] [DEBUG]
[2023-06-15 15:19:58.153] [DEBUG] -- connect 10.210.76.6 -P2883 -umeta@ocp -pthCX6pIdoR
[2023-06-15 15:19:59.155] [ERROR] 10.210.76.6: failed to connect meta db
[2023-06-15 15:19:59.155] [INFO] [ERROR] 10.210.76.6: failed to connect meta db
[2023-06-15 15:19:59.156] [INFO]
[2023-06-15 15:19:59.156] [DEBUG] - sub start ref count to 0
[2023-06-15 15:19:59.156] [DEBUG] - export start
[2023-06-15 15:19:59.156] [ERROR] ocp-express start failed