【 使用环境 】生产环境
【 OB or 其他组件 】:使用obd启动部署的服务。
【 使用版本 】oceanbase-all-in-one-4.3.5
【问题描述】使用obd命令返回错误,所有obd相关的命令均不可用。概率性问题,重启电脑又可正常启动。
【复现路径】系统启动后使用自动拉起服务调用obd命令“ obd cluster start demo”
【日志】返回错误:
12月 22 14:42:36 SmartLinkOMC1 obd[209999]: [209999] Failed to extract Crypto/Cipher/_ARC4.abi3.so: decompression r>
12月 22 14:42:36 SmartLinkOMC1 systemd[1]: oceanbase.service: Control process exited, code=exited, status=255/EXCEP>
12月 22 14:42:36 SmartLinkOMC1 systemd[1]: oceanbase.service: Failed with result ‘exit-code’.
12月 22 14:42:36 SmartLinkOMC1 systemd[1]: Failed to start oceanbase.
12月 22 14:42:41 SmartLinkOMC1 systemd[1]: oceanbase.service: Service RestartSec=5s expired, scheduling restart.
12月 22 14:42:41 SmartLinkOMC1 systemd[1]: oceanbase.service: Scheduled restart job, restart counter is at 6.
12月 22 14:42:41 SmartLinkOMC1 systemd[1]: Stopped oceanbase.
12月 22 14:42:41 SmartLinkOMC1 systemd[1]: Starting oceanbase…
3 个赞
在发生问题的时间点,obd工具没有相关打印。
我们在14.41分后,尝试使用obd启动oceanbase服务失败。而obd工具只有14:01分前的打印。
1 个赞
内容较多时保存不了,obd最后的打印如下:
[2025-12-22 14:01:13.438] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] obclient -h127.0.0.1 -P2881 -uroot -p’’ -Doceanbase -A
[2025-12-22 14:01:13.438] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO]
[2025-12-22 14:01:13.438] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – execute sql: select unix_timestamp(gmt_create) as gmt_create from oceanbase.__all_virtual_sys_variable limit 1. args: None
[2025-12-22 14:01:13.449] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] cluster unique id: 1b07ebd6-3c2f-5797-9f3a-66cef2a9466a-19a90b970fc-00050304
[2025-12-22 14:01:13.449] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO]
[2025-12-22 14:01:13.449] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - sub display ref count to 0
[2025-12-22 14:01:13.449] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - export display
[2025-12-22 14:01:13.449] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - plugin oceanbase-ce-py_script_display-3.1.0 result: True
[2025-12-22 14:01:13.449] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Searching connect plugin for components …
[2025-12-22 14:01:13.449] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Searching connect plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2025-12-22 14:01:13.450] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-4.2.2
[2025-12-22 14:01:13.450] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Call plugin obagent-py_script_connect-1.3.0 for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2025-12-22 14:01:13.450] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - import connect
[2025-12-22 14:01:13.451] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - add connect ref count to 1
[2025-12-22 14:01:13.452] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] Connect to Obagent
[2025-12-22 14:01:13.452] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect obagent (127.0.0.1:8089 by user admin)
[2025-12-22 14:01:13.452] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.503] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect obagent (127.0.0.1:8089 by user admin)
[2025-12-22 14:01:13.503] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.552] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect obagent (127.0.0.1:8089 by user admin)
[2025-12-22 14:01:13.552] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.601] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect obagent (127.0.0.1:8089 by user admin)
[2025-12-22 14:01:13.601] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.650] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect obagent (127.0.0.1:8089 by user admin)
[2025-12-22 14:01:13.650] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.699] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect obagent (127.0.0.1:8089 by user admin)
[2025-12-22 14:01:13.699] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.748] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect obagent (127.0.0.1:8089 by user admin)
[2025-12-22 14:01:13.748] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.797] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect obagent (127.0.0.1:8089 by user admin)
[2025-12-22 14:01:13.797] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.846] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect obagent (127.0.0.1:8089 by user admin)
[2025-12-22 14:01:13.846] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.896] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect obagent (127.0.0.1:8089 by user admin)
[2025-12-22 14:01:13.896] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.946] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - sub connect ref count to 0
[2025-12-22 14:01:13.947] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - export connect
[2025-12-22 14:01:13.947] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - plugin obagent-py_script_connect-1.3.0 result: True
[2025-12-22 14:01:13.947] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Searching display plugin for components …
[2025-12-22 14:01:13.947] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Searching display plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2025-12-22 14:01:13.947] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-4.2.2
[2025-12-22 14:01:13.947] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Call plugin obagent-py_script_display-1.3.0 for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2025-12-22 14:01:13.947] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - import display
[2025-12-22 14:01:13.948] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - add display ref count to 1
[2025-12-22 14:01:13.949] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – send http request method: GET, url: http://127.0.0.1:8089/api/v1/agent/status, data: None
[2025-12-22 14:01:13.998] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] ±-------------------------------------------------------------+
[2025-12-22 14:01:13.998] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] | obagent |
[2025-12-22 14:01:13.998] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] ±----------±-------------------±-------------------±-------+
[2025-12-22 14:01:13.998] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] | ip | mgragent_http_port | monagent_http_port | status |
[2025-12-22 14:01:13.998] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] ±----------±-------------------±-------------------±-------+
[2025-12-22 14:01:13.998] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] | 127.0.0.1 | 8089 | 8088 | active |
[2025-12-22 14:01:13.998] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] ±----------±-------------------±-------------------±-------+
[2025-12-22 14:01:13.998] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - sub display ref count to 0
[2025-12-22 14:01:13.998] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - export display
[2025-12-22 14:01:13.999] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - plugin obagent-py_script_display-1.3.0 result: True
[2025-12-22 14:01:13.999] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Searching connect plugin for components …
[2025-12-22 14:01:13.999] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Searching connect plugin for obproxy-ce-4.3.2.0-42.el7-b7ae0af3860478f3caecaaec05bd67d0565e4021
[2025-12-22 14:01:13.999] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.3.2.0
[2025-12-22 14:01:13.999] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Call plugin obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.3.2.0-42.el7-b7ae0af3860478f3caecaaec05bd67d0565e4021
[2025-12-22 14:01:14.000] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] Connect to obproxy
[2025-12-22 14:01:14.001] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – connect 127.0.0.1 -P2883 -uroot@proxysys -p
[2025-12-22 14:01:14.003] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - plugin obproxy-ce-py_script_connect-3.1.0 result: True
[2025-12-22 14:01:14.003] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Searching display plugin for components …
[2025-12-22 14:01:14.003] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Searching display plugin for obproxy-ce-4.3.2.0-42.el7-b7ae0af3860478f3caecaaec05bd67d0565e4021
[2025-12-22 14:01:14.003] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Found for obproxy-ce-py_script_display-4.3.0 for obproxy-ce-4.3.2.0
[2025-12-22 14:01:14.003] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Call plugin obproxy-ce-py_script_display-4.3.0 for obproxy-ce-4.3.2.0-42.el7-b7ae0af3860478f3caecaaec05bd67d0565e4021
[2025-12-22 14:01:14.003] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - import display
[2025-12-22 14:01:14.004] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - add display ref count to 1
[2025-12-22 14:01:14.005] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] – execute sql: show proxyconfig like “%port”. args: None
[2025-12-22 14:01:14.011] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] ±--------------------------------------------------------------+
[2025-12-22 14:01:14.011] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] | obproxy-ce |
[2025-12-22 14:01:14.011] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] ±----------±-----±----------------±----------------±-------+
[2025-12-22 14:01:14.011] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] | ip | port | prometheus_port | rpc_listen_port | status |
[2025-12-22 14:01:14.011] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] ±----------±-----±----------------±----------------±-------+
[2025-12-22 14:01:14.011] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] | 127.0.0.1 | 2883 | 2884 | 2885 | active |
[2025-12-22 14:01:14.011] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] ±----------±-----±----------------±----------------±-------+
[2025-12-22 14:01:14.013] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] obclient -h127.0.0.1 -P2883 -uroot -p’’ -Doceanbase -A
[2025-12-22 14:01:14.013] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO]
[2025-12-22 14:01:14.013] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - sub display ref count to 0
[2025-12-22 14:01:14.013] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - export display
[2025-12-22 14:01:14.013] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - plugin obproxy-ce-py_script_display-4.3.0 result: True
[2025-12-22 14:01:14.013] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - Set demo deploy status to running
[2025-12-22 14:01:14.013] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - dump deploy info to /root/.obd/cluster/demo/.data
[2025-12-22 14:01:14.016] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] demo running
[2025-12-22 14:01:14.019] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 5
[2025-12-22 14:01:14.019] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 4
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 3
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 2
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 1
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 0
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - unlock /root/.obd/lock/mirror_and_repo
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - exclusive lock /root/.obd/lock/deploy_demo release, count 0
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - unlock /root/.obd/lock/deploy_demo
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - share lock /root/.obd/lock/global release, count 0
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [DEBUG] - unlock /root/.obd/lock/global
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] Trace ID: 8bdc2230-defb-11f0-a300-c85309282a05
[2025-12-22 14:01:14.020] [8bdc2230-defb-11f0-a300-c85309282a05] [INFO] If you want to view detailed obd logs, please run: obd display-trace 8bdc2230-defb-11f0-a300-c85309282a05
报错信息:
12月 22 14:41:35 SmartLinkOMC1 obd[209371]: [209371] Failed to extract Crypto/Cipher/_ARC4.abi3.so: decompression r>
12月 22 14:41:35 SmartLinkOMC1 systemd[1]: oceanbase.service: Control process exited, code=exited, status=255/EXCEP>
12月 22 14:41:35 SmartLinkOMC1 systemd[1]: oceanbase.service: Failed with result ‘exit-code’.
12月 22 14:41:35 SmartLinkOMC1 systemd[1]: Failed to start oceanbase.
12月 22 14:41:40 SmartLinkOMC1 systemd[1]: oceanbase.service: Service RestartSec=5s expired, scheduling restart.
12月 22 14:41:40 SmartLinkOMC1 systemd[1]: oceanbase.service: Scheduled restart job, restart counter is at 3.
12月 22 14:41:40 SmartLinkOMC1 systemd[1]: Stopped oceanbase.
12月 22 14:41:40 SmartLinkOMC1 systemd[1]: Starting oceanbase…
12月 22 14:41:55 SmartLinkOMC1 obd[209652]: [209652] Failed to extract Crypto/Cipher/_ARC4.abi3.so: decompression r>
12月 22 14:41:55 SmartLinkOMC1 systemd[1]: oceanbase.service: Control process exited, code=exited, status=255/EXCEP>
12月 22 14:41:55 SmartLinkOMC1 systemd[1]: oceanbase.service: Failed with result ‘exit-code’.
12月 22 14:41:55 SmartLinkOMC1 systemd[1]: Failed to start oceanbase.
12月 22 14:42:00 SmartLinkOMC1 systemd[1]: oceanbase.service: Service RestartSec=5s expired, scheduling restart.
12月 22 14:42:00 SmartLinkOMC1 systemd[1]: oceanbase.service: Scheduled restart job, restart counter is at 4.
12月 22 14:42:00 SmartLinkOMC1 systemd[1]: Stopped oceanbase.
12月 22 14:42:00 SmartLinkOMC1 systemd[1]: Starting oceanbase…
12月 22 14:42:15 SmartLinkOMC1 obd[209925]: [209925] Failed to extract Crypto/Cipher/_ARC4.abi3.so: decompression r>
12月 22 14:42:15 SmartLinkOMC1 systemd[1]: oceanbase.service: Control process exited, code=exited, status=255/EXCEP>
12月 22 14:42:15 SmartLinkOMC1 systemd[1]: oceanbase.service: Failed with result ‘exit-code’.
12月 22 14:42:15 SmartLinkOMC1 systemd[1]: Failed to start oceanbase.
12月 22 14:42:21 SmartLinkOMC1 systemd[1]: oceanbase.service: Service RestartSec=5s expired, scheduling restart.
12月 22 14:42:21 SmartLinkOMC1 systemd[1]: oceanbase.service: Scheduled restart job, restart counter is at 5.
12月 22 14:42:21 SmartLinkOMC1 systemd[1]: Stopped oceanbase.
12月 22 14:42:21 SmartLinkOMC1 systemd[1]: Starting oceanbase…
12月 22 14:42:36 SmartLinkOMC1 obd[209999]: [209999] Failed to extract Crypto/Cipher/_ARC4.abi3.so: decompression r>
12月 22 14:42:36 SmartLinkOMC1 systemd[1]: oceanbase.service: Control process exited, code=exited, status=255/EXCEP>
12月 22 14:42:36 SmartLinkOMC1 systemd[1]: oceanbase.service: Failed with result ‘exit-code’.
12月 22 14:42:36 SmartLinkOMC1 systemd[1]: Failed to start oceanbase.
12月 22 14:42:41 SmartLinkOMC1 systemd[1]: oceanbase.service: Service RestartSec=5s expired, scheduling restart.
12月 22 14:42:41 SmartLinkOMC1 systemd[1]: oceanbase.service: Scheduled restart job, restart counter is at 6.
12月 22 14:42:41 SmartLinkOMC1 systemd[1]: Stopped oceanbase.
12月 22 14:42:41 SmartLinkOMC1 systemd[1]: Starting oceanbase…
1 个赞
辞霜
#8
看obd日志 命令可以正常使用demo running。
你目前问题是obd命令不可用么
1 个赞
这个问题最后一次出现还是在两个月前,当时没有取oceanbase的log,现在log已经被清理了。
而且这个问题和oceanbase关系不大,oceanbase在问题发生的事件段没有log产生。
在14:01分使用obd工具启动oceanbase服务时,当时查看了没有新的oceanbase日志生成。
而且使用任何与obd工具相关的命令均会报这个错误。
例如在命令行使用命令“obd cluster list”也会返回报错“Failed to extract Crypto/Cipher/_ARC4.abi3.so: decompression resulted in return code -1!”。
1 个赞