服务器断电后重启,数据库无法启动

【 使用环境 】 测试环境
【 使用版本 】4.2.2

Trace ID: 0ffd51ba-f73b-11ee-8da3-000c29d02be4
If you want to view detailed obd logs, please run: obd display-trace 0ffd51ba-f73b-11ee-8da3-000c29d02be4
[root@localhost ~]# obd cluster display powersmart
Get local repositories and plugins ok
Open ssh connection ok
Cluster status check ok
[WARN] 192.168.4.32 oceanbase-ce is stopped
[WARN] 192.168.4.32 obproxy-ce is stopped
[WARN] 192.168.4.32 obagent is stopped
[WARN] 192.168.4.32 ocp-express is stopped
Trace ID: 1b1136de-f73b-11ee-8d58-000c29d02be4
If you want to view detailed obd logs, please run: obd display-trace 1b1136de-f73b-11ee-8d58-000c29d02be4
[root@localhost ~]#  obd display-trace 1b1136de-f73b-11ee-8d58-000c29d02be4
[2024-04-10 21:06:12.431] [DEBUG] - cmd: ['powersmart']
[2024-04-10 21:06:12.431] [DEBUG] - opts: {}
[2024-04-10 21:06:12.431] [DEBUG] - mkdir /root/.obd/lock/
[2024-04-10 21:06:12.431] [DEBUG] - unknown lock mode 
[2024-04-10 21:06:12.432] [DEBUG] - try to get share lock /root/.obd/lock/global
[2024-04-10 21:06:12.432] [DEBUG] - share lock `/root/.obd/lock/global`, count 1
[2024-04-10 21:06:12.432] [DEBUG] - Get Deploy by name
[2024-04-10 21:06:12.432] [DEBUG] - mkdir /root/.obd/cluster/
[2024-04-10 21:06:12.432] [DEBUG] - mkdir /root/.obd/config_parser/
[2024-04-10 21:06:12.432] [DEBUG] - try to get exclusive lock /root/.obd/lock/deploy_powersmart
[2024-04-10 21:06:12.433] [DEBUG] - exclusive lock `/root/.obd/lock/deploy_powersmart`, count 1
[2024-04-10 21:06:12.440] [DEBUG] - Deploy status judge
[2024-04-10 21:06:12.440] [DEBUG] - Get deploy config
[2024-04-10 21:06:12.505] [INFO] Get local repositories and plugins
[2024-04-10 21:06:12.505] [DEBUG] - mkdir /root/.obd/repository
[2024-04-10 21:06:12.506] [DEBUG] - Get local repository oceanbase-ce-4.2.2.1-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-04-10 21:06:12.532] [DEBUG] - try to get share lock /root/.obd/lock/mirror_and_repo
[2024-04-10 21:06:12.532] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 1
[2024-04-10 21:06:12.543] [DEBUG] - Get local repository obproxy-ce-4.2.3.0-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-04-10 21:06:12.565] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 2
[2024-04-10 21:06:12.570] [DEBUG] - Get local repository obagent-4.2.2-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-04-10 21:06:12.588] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 3
[2024-04-10 21:06:12.592] [DEBUG] - Get local repository ocp-express-4.2.2-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-04-10 21:06:12.593] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 4
[2024-04-10 21:06:12.605] [DEBUG] - Searching param plugin for components ...
[2024-04-10 21:06:12.605] [DEBUG] - Search param plugin for oceanbase-ce
[2024-04-10 21:06:12.605] [DEBUG] - mkdir /root/.obd/plugins
[2024-04-10 21:06:12.714] [DEBUG] - Found for oceanbase-ce-param-4.2.2.0 for oceanbase-ce-4.2.2.1
[2024-04-10 21:06:12.714] [DEBUG] - Applying oceanbase-ce-param-4.2.2.0 for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-04-10 21:06:13.351] [DEBUG] - Search param plugin for obproxy-ce
[2024-04-10 21:06:13.352] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.2.3.0
[2024-04-10 21:06:13.352] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-04-10 21:06:13.521] [DEBUG] - Search param plugin for obagent
[2024-04-10 21:06:13.549] [DEBUG] - Found for obagent-param-1.3.0 for obagent-4.2.2
[2024-04-10 21:06:13.549] [DEBUG] - Applying obagent-param-1.3.0 for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-04-10 21:06:13.636] [DEBUG] - Search param plugin for ocp-express
[2024-04-10 21:06:13.637] [DEBUG] - Found for ocp-express-param-4.1.0 for ocp-express-4.2.2
[2024-04-10 21:06:13.637] [DEBUG] - Applying ocp-express-param-4.1.0 for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-04-10 21:06:13.747] [DEBUG] - Searching connect plugin for components ...
[2024-04-10 21:06:13.748] [DEBUG] - Searching connect plugin for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-04-10 21:06:13.749] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.2.2.1
[2024-04-10 21:06:13.749] [DEBUG] - Searching connect plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-04-10 21:06:13.749] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.3.0
[2024-04-10 21:06:13.749] [DEBUG] - Searching connect plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-04-10 21:06:13.750] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-4.2.2
[2024-04-10 21:06:13.750] [DEBUG] - Searching connect plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-04-10 21:06:13.750] [DEBUG] - Found for ocp-express-py_script_connect-1.0.1 for ocp-express-4.2.2
[2024-04-10 21:06:13.750] [DEBUG] - Searching display plugin for components ...
[2024-04-10 21:06:13.750] [DEBUG] - Searching display plugin for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-04-10 21:06:13.751] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.2.1
[2024-04-10 21:06:13.751] [DEBUG] - Searching display plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-04-10 21:06:13.751] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.3.0
[2024-04-10 21:06:13.751] [DEBUG] - Searching display plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-04-10 21:06:13.751] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-4.2.2
[2024-04-10 21:06:13.751] [DEBUG] - Searching display plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-04-10 21:06:13.752] [DEBUG] - Found for ocp-express-py_script_display-1.0.1 for ocp-express-4.2.2
[2024-04-10 21:06:13.879] [INFO] Open ssh connection
[2024-04-10 21:06:13.880] [DEBUG] - host: 192.168.4.32, port: 22, user: root, password: bowo!32
[2024-04-10 21:06:14.453] [INFO] Cluster status check
[2024-04-10 21:06:14.454] [DEBUG] - Searching status plugin for components ...
[2024-04-10 21:06:14.454] [DEBUG] - Searching status plugin for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-04-10 21:06:14.455] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.2.2.1
[2024-04-10 21:06:14.455] [DEBUG] - Searching status plugin for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-04-10 21:06:14.455] [DEBUG] - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.2.3.0
[2024-04-10 21:06:14.455] [DEBUG] - Searching status plugin for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-04-10 21:06:14.456] [DEBUG] - Found for obagent-py_script_status-1.3.0 for obagent-4.2.2
[2024-04-10 21:06:14.456] [DEBUG] - Searching status plugin for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-04-10 21:06:14.456] [DEBUG] - Found for ocp-express-py_script_status-1.0 for ocp-express-4.2.2
[2024-04-10 21:06:14.456] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.2.2.1-101000012024030709.el7-3e30b9c0f183a5ef764ab754d5e517a671d96b38
[2024-04-10 21:06:14.457] [DEBUG] - import status
[2024-04-10 21:06:14.471] [DEBUG] - add status ref count to 1
[2024-04-10 21:06:14.472] [DEBUG] -- root@192.168.4.32 execute: cat /root/powersmart/oceanbase/run/observer.pid 
[2024-04-10 21:06:14.818] [DEBUG] -- exited code 0
[2024-04-10 21:06:14.818] [DEBUG] -- root@192.168.4.32 execute: ls /proc/10361 
[2024-04-10 21:06:15.048] [DEBUG] -- exited code 2, error output:
[2024-04-10 21:06:15.048] [DEBUG] ls: 无法访问/proc/10361: 没有那个文件或目录
[2024-04-10 21:06:15.048] [DEBUG] 
[2024-04-10 21:06:15.049] [DEBUG] - sub status ref count to 0
[2024-04-10 21:06:15.049] [DEBUG] - export status
[2024-04-10 21:06:15.049] [DEBUG] - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.2.3.0-3.el7-0490ebc04220def8d25cb9cac9ac61a4efa6d639
[2024-04-10 21:06:15.049] [DEBUG] - import status
[2024-04-10 21:06:15.062] [DEBUG] - add status ref count to 1
[2024-04-10 21:06:15.062] [DEBUG] -- root@192.168.4.32 execute: cat /root/powersmart/obproxy/run/obproxy-192.168.4.32-2883.pid 
[2024-04-10 21:06:15.272] [DEBUG] -- exited code 0
[2024-04-10 21:06:15.272] [DEBUG] -- root@192.168.4.32 execute: ls /proc/16249 
[2024-04-10 21:06:15.483] [DEBUG] -- exited code 2, error output:
[2024-04-10 21:06:15.483] [DEBUG] ls: 无法访问/proc/16249: 没有那个文件或目录
[2024-04-10 21:06:15.483] [DEBUG] 
[2024-04-10 21:06:15.484] [DEBUG] - sub status ref count to 0
[2024-04-10 21:06:15.484] [DEBUG] - export status
[2024-04-10 21:06:15.484] [DEBUG] - Call obagent-py_script_status-1.3.0 for obagent-4.2.2-100000042024011120.el7-19739a07a12eab736aff86ecf357b1ae660b554e
[2024-04-10 21:06:15.484] [DEBUG] - import status
[2024-04-10 21:06:15.485] [DEBUG] - add status ref count to 1
[2024-04-10 21:06:15.486] [DEBUG] -- root@192.168.4.32 execute: cat /root/powersmart/obagent/run/ob_agentd.pid 
[2024-04-10 21:06:15.727] [DEBUG] -- exited code 0
[2024-04-10 21:06:15.727] [DEBUG] -- root@192.168.4.32 execute: ls /proc/16627 
[2024-04-10 21:06:15.978] [DEBUG] -- exited code 2, error output:
[2024-04-10 21:06:15.978] [DEBUG] ls: 无法访问/proc/16627: 没有那个文件或目录
[2024-04-10 21:06:15.978] [DEBUG] 
[2024-04-10 21:06:15.978] [DEBUG] - sub status ref count to 0
[2024-04-10 21:06:15.978] [DEBUG] - export status
[2024-04-10 21:06:15.978] [DEBUG] - Call ocp-express-py_script_status-1.0 for ocp-express-4.2.2-100000022024011120.el7-09ffcf156d1df9318a78af52656f499d2315e3f7
[2024-04-10 21:06:15.978] [DEBUG] - import status
[2024-04-10 21:06:15.993] [DEBUG] - add status ref count to 1
[2024-04-10 21:06:15.994] [DEBUG] -- root@192.168.4.32 execute: cat /root/powersmart/ocpexpress/run/ocp-express.pid 
[2024-04-10 21:06:16.230] [DEBUG] -- exited code 0
[2024-04-10 21:06:16.230] [DEBUG] -- root@192.168.4.32 execute: ls /proc/16986 
[2024-04-10 21:06:16.479] [DEBUG] -- exited code 2, error output:
[2024-04-10 21:06:16.479] [DEBUG] ls: 无法访问/proc/16986: 没有那个文件或目录
[2024-04-10 21:06:16.479] [DEBUG] 
[2024-04-10 21:06:16.480] [DEBUG] - sub status ref count to 0
[2024-04-10 21:06:16.480] [DEBUG] - export status
[2024-04-10 21:06:16.543] [WARNING] 192.168.4.32 oceanbase-ce is stopped
[2024-04-10 21:06:16.543] [WARNING] 192.168.4.32 obproxy-ce is stopped
[2024-04-10 21:06:16.543] [WARNING] 192.168.4.32 obagent is stopped
[2024-04-10 21:06:16.543] [WARNING] 192.168.4.32 ocp-express is stopped
[2024-04-10 21:06:16.543] [INFO] Trace ID: 1b1136de-f73b-11ee-8d58-000c29d02be4
[2024-04-10 21:06:16.543] [INFO] If you want to view detailed obd logs, please run: obd display-trace 1b1136de-f73b-11ee-8d58-000c29d02be4
[2024-04-10 21:06:16.543] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 3
[2024-04-10 21:06:16.543] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 2
[2024-04-10 21:06:16.543] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 1
[2024-04-10 21:06:16.543] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 0
[2024-04-10 21:06:16.543] [DEBUG] - unlock /root/.obd/lock/mirror_and_repo
[2024-04-10 21:06:16.544] [DEBUG] - exclusive lock /root/.obd/lock/deploy_powersmart release, count 0
[2024-04-10 21:06:16.544] [DEBUG] - unlock /root/.obd/lock/deploy_powersmart
[2024-04-10 21:06:16.544] [DEBUG] - share lock /root/.obd/lock/global release, count 0
[2024-04-10 21:06:16.544] [DEBUG] - unlock /root/.obd/lock/global

需要重新启动一下集群之后才能通过obd cluster display查看集群连接信息,启动命令:obd cluster start powersmart