服务器意外断电后部分服务无法启动

麻烦提供一下obd日志,建议先使用obdiag进行一下巡检方便排查目前集群存在哪些问题
https://www.oceanbase.com/docs/common-obdiag-cn-1000000000791134

补充提供下:
obd日志:/home/admin/.obd/log
observer及相应日志:/home/admin/oceanbase/log下 observer.log,rootservice.log,election.log

log.tar.gz (6.9 MB)
obd.log.tar.gz (106.9 KB)

请问是否使用alter修改过用户密码

1.运行下 obd display-trace fa332792-3826-11ef-bfc8-0242c0d94554 将输出发下
2.ps -ef|grep observer 将输出发下

root@167-68:/dbdata/myoceanbase# obd display-trace fa332792-3826-11ef-bfc8-0242c0d94554
[2024-07-02 11:55:52.934] [DEBUG] - cmd: [‘myoceanbase’]
[2024-07-02 11:55:52.934] [DEBUG] - opts: {‘servers’: None, ‘components’: None, ‘force_delete’: None, ‘strict_check’: None, ‘without_parameter’: None}
[2024-07-02 11:55:52.935] [DEBUG] - mkdir /root/.obd/lock/
[2024-07-02 11:55:52.935] [DEBUG] - unknown lock mode
[2024-07-02 11:55:52.935] [DEBUG] - try to get share lock /root/.obd/lock/global
[2024-07-02 11:55:52.936] [DEBUG] - share lock /root/.obd/lock/global, count 1
[2024-07-02 11:55:52.936] [DEBUG] - Get Deploy by name
[2024-07-02 11:55:52.936] [DEBUG] - mkdir /root/.obd/cluster/
[2024-07-02 11:55:52.936] [DEBUG] - mkdir /root/.obd/config_parser/
[2024-07-02 11:55:52.936] [DEBUG] - try to get exclusive lock /root/.obd/lock/deploy_myoceanbase
[2024-07-02 11:55:52.937] [DEBUG] - exclusive lock /root/.obd/lock/deploy_myoceanbase, count 1
[2024-07-02 11:55:52.946] [DEBUG] - Deploy status judge
[2024-07-02 11:55:52.947] [INFO] Get local repositories
[2024-07-02 11:55:52.948] [DEBUG] - mkdir /root/.obd/repository
[2024-07-02 11:55:52.948] [DEBUG] - Get local repository oceanbase-ce-4.3.0.1-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:52.948] [DEBUG] - Search repository oceanbase-ce version: 4.3.0.1, tag: f0165daceff0ec4a1074bd50fd15e887082e9bd9, release: None, package_hash: None
[2024-07-02 11:55:52.948] [DEBUG] - try to get share lock /root/.obd/lock/mirror_and_repo
[2024-07-02 11:55:52.949] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 1
[2024-07-02 11:55:52.949] [DEBUG] - mkdir /root/.obd/repository/oceanbase-ce
[2024-07-02 11:55:52.952] [DEBUG] - Found repository oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:52.952] [DEBUG] - Get local repository obproxy-ce-4.2.3.0-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:52.952] [DEBUG] - Search repository obproxy-ce version: 4.2.3.0, tag: 2724edc3c9c4693fab71d53b52b82b98ceacdf70, release: None, package_hash: None
[2024-07-02 11:55:52.953] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 2
[2024-07-02 11:55:52.953] [DEBUG] - mkdir /root/.obd/repository/obproxy-ce
[2024-07-02 11:55:52.956] [DEBUG] - Found repository obproxy-ce-4.2.3.0-3.el8-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:52.956] [DEBUG] - Get local repository obagent-4.2.2-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:52.956] [DEBUG] - Search repository obagent version: 4.2.2, tag: d8172a2bf3811219777124490558bf800dffef87, release: None, package_hash: None
[2024-07-02 11:55:52.956] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 3
[2024-07-02 11:55:52.956] [DEBUG] - mkdir /root/.obd/repository/obagent
[2024-07-02 11:55:52.960] [DEBUG] - Found repository obagent-4.2.2-100000042024011120.el8-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:52.960] [DEBUG] - Get local repository ocp-express-4.2.2-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:52.960] [DEBUG] - Search repository ocp-express version: 4.2.2, tag: 44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e, release: None, package_hash: None
[2024-07-02 11:55:52.960] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo, count 4
[2024-07-02 11:55:52.960] [DEBUG] - mkdir /root/.obd/repository/ocp-express
[2024-07-02 11:55:52.963] [DEBUG] - Found repository ocp-express-4.2.2-100000022024011120.el8-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:53.078] [DEBUG] - Get deploy config
[2024-07-02 11:55:53.118] [INFO] Search plugins
[2024-07-02 11:55:53.118] [DEBUG] - Searching start_check plugin for components …
[2024-07-02 11:55:53.119] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:53.119] [DEBUG] - mkdir /root/.obd/plugins
[2024-07-02 11:55:53.121] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.2.2.0 for oceanbase-ce-4.3.0.1
[2024-07-02 11:55:53.121] [DEBUG] - Searching start_check plugin for obproxy-ce-4.2.3.0-3.el8-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:53.122] [DEBUG] - Found for obproxy-ce-py_script_start_check-4.2.3 for obproxy-ce-4.2.3.0
[2024-07-02 11:55:53.122] [DEBUG] - Searching start_check plugin for obagent-4.2.2-100000042024011120.el8-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:53.123] [DEBUG] - Found for obagent-py_script_start_check-1.3.0 for obagent-4.2.2
[2024-07-02 11:55:53.123] [DEBUG] - Searching start_check plugin for ocp-express-4.2.2-100000022024011120.el8-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:53.123] [DEBUG] - Found for ocp-express-py_script_start_check-4.2.2 for ocp-express-4.2.2
[2024-07-02 11:55:53.124] [DEBUG] - Searching create_tenant plugin for components …
[2024-07-02 11:55:53.124] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:53.124] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.3.0.0 for oceanbase-ce-4.3.0.1
[2024-07-02 11:55:53.124] [DEBUG] - Searching create_tenant plugin for obproxy-ce-4.2.3.0-3.el8-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:53.125] [DEBUG] - No such create_tenant plugin for obproxy-ce-4.2.3.0
[2024-07-02 11:55:53.125] [DEBUG] - Searching create_tenant plugin for obagent-4.2.2-100000042024011120.el8-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:53.125] [DEBUG] - No such create_tenant plugin for obagent-4.2.2
[2024-07-02 11:55:53.125] [DEBUG] - Searching create_tenant plugin for ocp-express-4.2.2-100000022024011120.el8-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:53.125] [DEBUG] - No such create_tenant plugin for ocp-express-4.2.2
[2024-07-02 11:55:53.125] [DEBUG] - Searching tenant_optimize plugin for components …
[2024-07-02 11:55:53.125] [DEBUG] - Searching tenant_optimize plugin for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:53.126] [DEBUG] - Found for oceanbase-ce-py_script_tenant_optimize-4.3.0.0 for oceanbase-ce-4.3.0.1
[2024-07-02 11:55:53.126] [DEBUG] - Searching tenant_optimize plugin for obproxy-ce-4.2.3.0-3.el8-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:53.126] [DEBUG] - No such tenant_optimize plugin for obproxy-ce-4.2.3.0
[2024-07-02 11:55:53.126] [DEBUG] - Searching tenant_optimize plugin for obagent-4.2.2-100000042024011120.el8-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:53.127] [DEBUG] - No such tenant_optimize plugin for obagent-4.2.2
[2024-07-02 11:55:53.127] [DEBUG] - Searching tenant_optimize plugin for ocp-express-4.2.2-100000022024011120.el8-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:53.127] [DEBUG] - No such tenant_optimize plugin for ocp-express-4.2.2
[2024-07-02 11:55:53.127] [DEBUG] - Searching start plugin for components …
[2024-07-02 11:55:53.127] [DEBUG] - Searching start plugin for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:53.128] [DEBUG] - Found for oceanbase-ce-py_script_start-4.3.0.0 for oceanbase-ce-4.3.0.1
[2024-07-02 11:55:53.128] [DEBUG] - Searching start plugin for obproxy-ce-4.2.3.0-3.el8-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:53.128] [DEBUG] - Found for obproxy-ce-py_script_start-4.2.3 for obproxy-ce-4.2.3.0
[2024-07-02 11:55:53.128] [DEBUG] - Searching start plugin for obagent-4.2.2-100000042024011120.el8-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:53.129] [DEBUG] - Found for obagent-py_script_start-1.3.0 for obagent-4.2.2
[2024-07-02 11:55:53.129] [DEBUG] - Searching start plugin for ocp-express-4.2.2-100000022024011120.el8-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:53.129] [DEBUG] - Found for ocp-express-py_script_start-4.2.2 for ocp-express-4.2.2
[2024-07-02 11:55:53.129] [DEBUG] - Searching connect plugin for components …
[2024-07-02 11:55:53.129] [DEBUG] - Searching connect plugin for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:53.130] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.0.1
[2024-07-02 11:55:53.130] [DEBUG] - Searching connect plugin for obproxy-ce-4.2.3.0-3.el8-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:53.130] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.3.0
[2024-07-02 11:55:53.130] [DEBUG] - Searching connect plugin for obagent-4.2.2-100000042024011120.el8-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:53.131] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-4.2.2
[2024-07-02 11:55:53.131] [DEBUG] - Searching connect plugin for ocp-express-4.2.2-100000022024011120.el8-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:53.131] [DEBUG] - Found for ocp-express-py_script_connect-1.0.1 for ocp-express-4.2.2
[2024-07-02 11:55:53.131] [DEBUG] - Searching bootstrap plugin for components …
[2024-07-02 11:55:53.131] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:53.132] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.2.2.0 for oceanbase-ce-4.3.0.1
[2024-07-02 11:55:53.132] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.2.3.0-3.el8-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:53.132] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.2.3.0
[2024-07-02 11:55:53.132] [DEBUG] - Searching bootstrap plugin for obagent-4.2.2-100000042024011120.el8-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:53.133] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-4.2.2
[2024-07-02 11:55:53.133] [DEBUG] - Searching bootstrap plugin for ocp-express-4.2.2-100000022024011120.el8-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:53.133] [DEBUG] - Found for ocp-express-py_script_bootstrap-1.0.1 for ocp-express-4.2.2
[2024-07-02 11:55:53.133] [DEBUG] - Searching display plugin for components …
[2024-07-02 11:55:53.133] [DEBUG] - Searching display plugin for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:53.134] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.3.0.1
[2024-07-02 11:55:53.134] [DEBUG] - Searching display plugin for obproxy-ce-4.2.3.0-3.el8-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:53.134] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.3.0
[2024-07-02 11:55:53.134] [DEBUG] - Searching display plugin for obagent-4.2.2-100000042024011120.el8-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:53.134] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-4.2.2
[2024-07-02 11:55:53.134] [DEBUG] - Searching display plugin for ocp-express-4.2.2-100000022024011120.el8-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:53.135] [DEBUG] - Found for ocp-express-py_script_display-1.0.1 for ocp-express-4.2.2
[2024-07-02 11:55:53.249] [INFO] Load cluster param plugin
[2024-07-02 11:55:53.250] [DEBUG] - Get local repository oceanbase-ce-4.3.0.1-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:53.250] [DEBUG] - Get local repository obproxy-ce-4.2.3.0-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:53.250] [DEBUG] - Get local repository obagent-4.2.2-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:53.250] [DEBUG] - Get local repository ocp-express-4.2.2-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:53.250] [DEBUG] - Searching param plugin for components …
[2024-07-02 11:55:53.250] [DEBUG] - Search param plugin for oceanbase-ce
[2024-07-02 11:55:53.251] [DEBUG] - Found for oceanbase-ce-param-4.3.0.0 for oceanbase-ce-4.3.0.1
[2024-07-02 11:55:53.251] [DEBUG] - Applying oceanbase-ce-param-4.3.0.0 for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:54.001] [DEBUG] - Search param plugin for obproxy-ce
[2024-07-02 11:55:54.001] [DEBUG] - Found for obproxy-ce-param-4.2.3 for obproxy-ce-4.2.3.0
[2024-07-02 11:55:54.001] [DEBUG] - Applying obproxy-ce-param-4.2.3 for obproxy-ce-4.2.3.0-3.el8-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:54.179] [DEBUG] - Search param plugin for obagent
[2024-07-02 11:55:54.179] [DEBUG] - Found for obagent-param-1.3.0 for obagent-4.2.2
[2024-07-02 11:55:54.179] [DEBUG] - Applying obagent-param-1.3.0 for obagent-4.2.2-100000042024011120.el8-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:54.266] [DEBUG] - Search param plugin for ocp-express
[2024-07-02 11:55:54.267] [DEBUG] - Found for ocp-express-param-4.1.0 for ocp-express-4.2.2
[2024-07-02 11:55:54.267] [DEBUG] - Applying ocp-express-param-4.1.0 for ocp-express-4.2.2-100000022024011120.el8-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:54.418] [INFO] Open ssh connection
[2024-07-02 11:55:54.419] [DEBUG] - host: 149.0.167.68, port: 22, user: root, password: XC@cqfy123
[2024-07-02 11:55:54.550] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.2.2.0 for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:54.550] [DEBUG] - import start_check
[2024-07-02 11:55:54.558] [DEBUG] - add start_check ref count to 1
[2024-07-02 11:55:54.558] [INFO] Check before start observer
[2024-07-02 11:55:54.561] [DEBUG] – root@149.0.167.68 execute: ls /dbdata/myoceanbase/oceanbase/store/clog/tenant_1/
[2024-07-02 11:55:54.616] [DEBUG] – exited code 0
[2024-07-02 11:55:54.616] [DEBUG] – root@149.0.167.68 execute: cat /dbdata/myoceanbase/oceanbase/run/observer.pid
[2024-07-02 11:55:54.661] [DEBUG] – exited code 1, error output:
[2024-07-02 11:55:54.662] [DEBUG] cat: /dbdata/myoceanbase/oceanbase/run/observer.pid: 没有那个文件或目录
[2024-07-02 11:55:54.662] [DEBUG]
[2024-07-02 11:55:54.662] [DEBUG] – 149.0.167.68 port check
[2024-07-02 11:55:54.662] [DEBUG] – root@149.0.167.68 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B41’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-07-02 11:55:54.723] [DEBUG] – exited code 0
[2024-07-02 11:55:54.724] [DEBUG] – root@149.0.167.68 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B42’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-07-02 11:55:54.783] [DEBUG] – exited code 0
[2024-07-02 11:55:54.784] [DEBUG] – root@149.0.167.68 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B46’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-07-02 11:55:54.843] [DEBUG] – exited code 0
[2024-07-02 11:55:54.843] [DEBUG] – root@149.0.167.68 execute: ls /dbdata/myoceanbase/oceanbase/store/sstable/block_file
[2024-07-02 11:55:54.890] [DEBUG] – exited code 0
[2024-07-02 11:55:54.890] [DEBUG] – root@149.0.167.68 execute: [ -w /tmp/ ] || [ -w /tmp/obshell ]
[2024-07-02 11:55:54.937] [DEBUG] – exited code 0
[2024-07-02 11:55:54.937] [DEBUG] – root@149.0.167.68 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr
[2024-07-02 11:55:54.985] [DEBUG] – exited code 0
[2024-07-02 11:55:54.986] [DEBUG] – root@149.0.167.68 execute: ulimit -a
[2024-07-02 11:55:55.033] [DEBUG] – exited code 0
[2024-07-02 11:55:55.034] [WARNING] OBD-1007: (149.0.167.68) The recommended number of stack size is unlimited (Current value: 10240)
[2024-07-02 11:55:55.034] [DEBUG] – root@149.0.167.68 execute: sysctl -a
[2024-07-02 11:55:55.096] [DEBUG] – exited code 0
[2024-07-02 11:55:55.101] [DEBUG] – root@149.0.167.68 execute: cat /proc/meminfo
[2024-07-02 11:55:55.141] [DEBUG] – exited code 0
[2024-07-02 11:55:55.142] [DEBUG] – root@149.0.167.68 execute: df --block-size=1024
[2024-07-02 11:55:55.190] [DEBUG] – exited code 0
[2024-07-02 11:55:55.190] [DEBUG] – get disk info for path /dev, total: 274378981376 avail: 274378981376
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /run, total: 54882074624 avail: 54813655040
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /, total: 210304475136 avail: 192235085824
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /dev/shm, total: 274410110976 avail: 274410110976
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /run/lock, total: 5242880 avail: 5242880
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /sys/fs/cgroup, total: 274410110976 avail: 274410110976
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /boot, total: 1551745024 avail: 1366097920
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /boot/efi, total: 313942016 avail: 313364480
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /recovery, total: 105152176128 avail: 99556446208
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /data, total: 2498330710016 avail: 2219520589824
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /dbdata, total: 27892740866048 avail: 23668197687296
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /var/lib/docker/overlay2/f6bcbd9ae51b17b952a165e892c608b279cf6a597bb8c2e4d02c601b4d4df38f/merged, total: 2498330710016 avail: 2219520589824
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /var/lib/docker/overlay2/bfc5e4376ca8f47982d7d6baf011414420edf2fe5b4a99c3f7671ef17b86b39f/merged, total: 2498330710016 avail: 2219520589824
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /run/user/1000, total: 54882009088 avail: 54882009088
[2024-07-02 11:55:55.191] [DEBUG] – get disk info for path /run/user/0, total: 54882009088 avail: 54882009088
[2024-07-02 11:55:55.192] [DEBUG] – disk: {’/dev’: {‘total’: 274378981376, ‘avail’: 274378981376, ‘need’: 0}, ‘/run’: {‘total’: 54882074624, ‘avail’: 54813655040, ‘need’: 0}, ‘/’: {‘total’: 210304475136, ‘avail’: 192235085824, ‘need’: 0}, ‘/dev/shm’: {‘total’: 274410110976, ‘avail’: 274410110976, ‘need’: 0}, ‘/run/lock’: {‘total’: 5242880, ‘avail’: 5242880, ‘need’: 0}, ‘/sys/fs/cgroup’: {‘total’: 274410110976, ‘avail’: 274410110976, ‘need’: 0}, ‘/boot’: {‘total’: 1551745024, ‘avail’: 1366097920, ‘need’: 0}, ‘/boot/efi’: {‘total’: 313942016, ‘avail’: 313364480, ‘need’: 0}, ‘/recovery’: {‘total’: 105152176128, ‘avail’: 99556446208, ‘need’: 0}, ‘/data’: {‘total’: 2498330710016, ‘avail’: 2219520589824, ‘need’: 0}, ‘/dbdata’: {‘total’: 27892740866048, ‘avail’: 23668197687296, ‘need’: 0}, ‘/var/lib/docker/overlay2/f6bcbd9ae51b17b952a165e892c608b279cf6a597bb8c2e4d02c601b4d4df38f/merged’: {‘total’: 2498330710016, ‘avail’: 2219520589824, ‘need’: 0}, ‘/var/lib/docker/overlay2/bfc5e4376ca8f47982d7d6baf011414420edf2fe5b4a99c3f7671ef17b86b39f/merged’: {‘total’: 2498330710016, ‘avail’: 2219520589824, ‘need’: 0}, ‘/run/user/1000’: {‘total’: 54882009088, ‘avail’: 54882009088, ‘need’: 0}, ‘/run/user/0’: {‘total’: 54882009088, ‘avail’: 54882009088, ‘need’: 0}}
[2024-07-02 11:55:55.192] [DEBUG] – root@149.0.167.68 execute: date +%s%N
[2024-07-02 11:55:55.237] [DEBUG] – exited code 0
[2024-07-02 11:55:55.238] [DEBUG] – 149.0.167.68 time delta -0.9267578125
[2024-07-02 11:55:55.342] [INFO] [WARN] OBD-1007: (149.0.167.68) The recommended number of stack size is unlimited (Current value: 10240)
[2024-07-02 11:55:55.342] [INFO]
[2024-07-02 11:55:55.343] [DEBUG] - sub start_check ref count to 0
[2024-07-02 11:55:55.343] [DEBUG] - export start_check
[2024-07-02 11:55:55.343] [DEBUG] - Call obproxy-ce-py_script_start_check-4.2.3 for obproxy-ce-4.2.3.0-3.el8-2724edc3c9c4693fab71d53b52b82b98ceacdf70
[2024-07-02 11:55:55.343] [DEBUG] - import start_check
[2024-07-02 11:55:55.345] [DEBUG] - add start_check ref count to 1
[2024-07-02 11:55:55.346] [INFO] Check before start obproxy
[2024-07-02 11:55:55.346] [WARNING] OBD-4521: The config observer_sys_password in obproxy-ce did not take effect, please config it in oceanbase-ce
[2024-07-02 11:55:55.347] [DEBUG] – root@149.0.167.68 execute: cat /dbdata/myoceanbase/obproxy/run/obproxy-149.0.167.68-2883.pid
[2024-07-02 11:55:55.364] [DEBUG] – exited code 0
[2024-07-02 11:55:55.364] [DEBUG] – root@149.0.167.68 execute: ls /proc/31071/fd
[2024-07-02 11:55:55.409] [DEBUG] – exited code 2, error output:
[2024-07-02 11:55:55.410] [DEBUG] ls: 无法访问’/proc/31071/fd’: 没有那个文件或目录
[2024-07-02 11:55:55.410] [DEBUG]
[2024-07-02 11:55:55.410] [DEBUG] – 149.0.167.68 port check
[2024-07-02 11:55:55.410] [DEBUG] – root@149.0.167.68 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B43’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-07-02 11:55:55.471] [DEBUG] – exited code 0
[2024-07-02 11:55:55.472] [DEBUG] – root@149.0.167.68 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B44’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-07-02 11:55:55.531] [DEBUG] – exited code 0
[2024-07-02 11:55:55.607] [INFO] [WARN] OBD-4521: The config observer_sys_password in obproxy-ce did not take effect, please config it in oceanbase-ce
[2024-07-02 11:55:55.607] [INFO]
[2024-07-02 11:55:55.607] [DEBUG] - sub start_check ref count to 0
[2024-07-02 11:55:55.607] [DEBUG] - export start_check
[2024-07-02 11:55:55.607] [DEBUG] - Call obagent-py_script_start_check-1.3.0 for obagent-4.2.2-100000042024011120.el8-d8172a2bf3811219777124490558bf800dffef87
[2024-07-02 11:55:55.608] [DEBUG] - import start_check
[2024-07-02 11:55:55.610] [DEBUG] - add start_check ref count to 1
[2024-07-02 11:55:55.611] [INFO] Check before start obagent
[2024-07-02 11:55:55.613] [DEBUG] – root@149.0.167.68 execute: cat /dbdata/myoceanbase/obagent/run/ob_agentd.pid
[2024-07-02 11:55:55.618] [DEBUG] – exited code 1, error output:
[2024-07-02 11:55:55.618] [DEBUG] cat: /dbdata/myoceanbase/obagent/run/ob_agentd.pid: 没有那个文件或目录
[2024-07-02 11:55:55.618] [DEBUG]
[2024-07-02 11:55:55.619] [DEBUG] – 149.0.167.68 port check
[2024-07-02 11:55:55.619] [DEBUG] – root@149.0.167.68 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:1F99’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-07-02 11:55:55.679] [DEBUG] – exited code 0
[2024-07-02 11:55:55.679] [DEBUG] – root@149.0.167.68 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:1F98’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-07-02 11:55:55.739] [DEBUG] – exited code 0
[2024-07-02 11:55:55.744] [DEBUG] - sub start_check ref count to 0
[2024-07-02 11:55:55.744] [DEBUG] - export start_check
[2024-07-02 11:55:55.744] [DEBUG] - Call ocp-express-py_script_start_check-4.2.2 for ocp-express-4.2.2-100000022024011120.el8-44a58e92455e3bb1ff8b3cd85c4e1e1cced4ea3e
[2024-07-02 11:55:55.744] [DEBUG] - import start_check
[2024-07-02 11:55:55.749] [DEBUG] - add start_check ref count to 1
[2024-07-02 11:55:55.749] [INFO] Check before start ocp-express
[2024-07-02 11:55:55.752] [DEBUG] – root@149.0.167.68 execute: cat /dbdata/myoceanbase/ocpexpress/run/ocp-express.pid
[2024-07-02 11:55:55.795] [DEBUG] – exited code 0
[2024-07-02 11:55:55.796] [DEBUG] – root@149.0.167.68 execute: ls /proc/31528
[2024-07-02 11:55:55.842] [DEBUG] – exited code 2, error output:
[2024-07-02 11:55:55.842] [DEBUG] ls: 无法访问’/proc/31528’: 没有那个文件或目录
[2024-07-02 11:55:55.842] [DEBUG]
[2024-07-02 11:55:55.842] [DEBUG] – root@149.0.167.68 execute: bash -c ‘cat /proc/net/{udp*,tcp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:1FF4’ | awk -F’ ’ ‘{print $3}’ | uniq
[2024-07-02 11:55:55.903] [DEBUG] – exited code 0
[2024-07-02 11:55:55.904] [DEBUG] – root@149.0.167.68 append ‘/dbdata/myoceanbase/ocpexpress/jre/bin:’ to PATH
[2024-07-02 11:55:55.904] [DEBUG] – root@149.0.167.68 execute: java -version
[2024-07-02 11:55:56.048] [DEBUG] – exited code 0
[2024-07-02 11:55:56.049] [DEBUG] – root@149.0.167.68 execute: cat /proc/meminfo
[2024-07-02 11:55:56.093] [DEBUG] – exited code 0
[2024-07-02 11:55:56.094] [DEBUG] – root@149.0.167.68 execute: df --block-size=1024
[2024-07-02 11:55:56.142] [DEBUG] – exited code 0
[2024-07-02 11:55:56.142] [DEBUG] – get disk info for path /dev, total: 274378981376 avail: 274378981376
[2024-07-02 11:55:56.142] [DEBUG] – get disk info for path /run, total: 54882074624 avail: 54813655040
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /, total: 210304475136 avail: 192235081728
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /dev/shm, total: 274410110976 avail: 274410110976
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /run/lock, total: 5242880 avail: 5242880
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /sys/fs/cgroup, total: 274410110976 avail: 274410110976
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /boot, total: 1551745024 avail: 1366097920
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /boot/efi, total: 313942016 avail: 313364480
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /recovery, total: 105152176128 avail: 99556446208
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /data, total: 2498330710016 avail: 2219520577536
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /dbdata, total: 27892740866048 avail: 23668197666816
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /var/lib/docker/overlay2/f6bcbd9ae51b17b952a165e892c608b279cf6a597bb8c2e4d02c601b4d4df38f/merged, total: 2498330710016 avail: 2219520577536
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /var/lib/docker/overlay2/bfc5e4376ca8f47982d7d6baf011414420edf2fe5b4a99c3f7671ef17b86b39f/merged, total: 2498330710016 avail: 2219520577536
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /run/user/1000, total: 54882009088 avail: 54882009088
[2024-07-02 11:55:56.143] [DEBUG] – get disk info for path /run/user/0, total: 54882009088 avail: 54882009088
[2024-07-02 11:55:56.143] [DEBUG] – root@149.0.167.68 execute: df --block-size=1024 /dbdata/myoceanbase/ocpexpress/log
[2024-07-02 11:55:56.189] [DEBUG] – exited code 0
[2024-07-02 11:55:56.190] [DEBUG] – get disk info for path /dbdata, total: 27892740866048 avail: 23668197662720
[2024-07-02 11:55:56.274] [DEBUG] - sub start_check ref count to 0
[2024-07-02 11:55:56.274] [DEBUG] - export start_check
[2024-07-02 11:55:56.274] [DEBUG] - Call oceanbase-ce-py_script_start-4.3.0.0 for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:55:56.274] [DEBUG] - import start
[2024-07-02 11:55:56.278] [DEBUG] - add start ref count to 1
[2024-07-02 11:55:56.278] [INFO] Start observer
[2024-07-02 11:55:56.279] [DEBUG] – root@149.0.167.68 execute: ls /dbdata/myoceanbase/oceanbase/store/clog/tenant_1/
[2024-07-02 11:55:56.283] [DEBUG] – exited code 0
[2024-07-02 11:55:56.284] [DEBUG] – root@149.0.167.68 execute: cat /dbdata/myoceanbase/oceanbase/run/observer.pid
[2024-07-02 11:55:56.329] [DEBUG] – exited code 1, error output:
[2024-07-02 11:55:56.329] [DEBUG] cat: /dbdata/myoceanbase/oceanbase/run/observer.pid: 没有那个文件或目录
[2024-07-02 11:55:56.329] [DEBUG]
[2024-07-02 11:55:56.330] [DEBUG] – 149.0.167.68 start command construction
[2024-07-02 11:55:56.330] [DEBUG] – starting 149.0.167.68 observer
[2024-07-02 11:55:56.330] [DEBUG] – root@149.0.167.68 set env LD_LIBRARY_PATH to ‘/dbdata/myoceanbase/oceanbase/lib:’
[2024-07-02 11:55:56.331] [DEBUG] – root@149.0.167.68 execute: cd /dbdata/myoceanbase/oceanbase; /dbdata/myoceanbase/oceanbase/bin/observer -r ‘149.0.167.68:2882:2881’ -p 2881 -P 2882 -z ‘zone1’ -n ‘myoceanbase’ -c 1717471694 -d ‘/dbdata/myoceanbase/oceanbase/store’ -I ‘149.0.167.68’ -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit=‘445G’,datafile_size=‘1336G’,system_memory=‘55296M’,log_disk_size=‘1228G’,cpu_count=94,datafile_maxsize=‘22265G’,datafile_next=‘2227G’
[2024-07-02 11:55:56.609] [DEBUG] – exited code 0
[2024-07-02 11:55:56.610] [DEBUG] – root@149.0.167.68 delete env LD_LIBRARY_PATH
[2024-07-02 11:55:56.669] [DEBUG] – start_obshell: True
[2024-07-02 11:55:56.669] [DEBUG] – root@149.0.167.68 execute: cat /dbdata/myoceanbase/oceanbase/run/obshell.pid
[2024-07-02 11:55:56.674] [DEBUG] – exited code 1, error output:
[2024-07-02 11:55:56.674] [DEBUG] cat: /dbdata/myoceanbase/oceanbase/run/obshell.pid: 没有那个文件或目录
[2024-07-02 11:55:56.674] [DEBUG]
[2024-07-02 11:55:56.675] [DEBUG] – root@149.0.167.68 set env OB_ROOT_PASSWORD to ‘‘iH(2EwqzU([0t[]x’’
[2024-07-02 11:55:56.675] [DEBUG] – start obshell: cd /dbdata/myoceanbase/oceanbase; /dbdata/myoceanbase/oceanbase/bin/obshell admin start --ip 149.0.167.68 --port 2886
[2024-07-02 11:55:56.675] [DEBUG] – root@149.0.167.68 execute: cd /dbdata/myoceanbase/oceanbase; /dbdata/myoceanbase/oceanbase/bin/obshell admin start --ip 149.0.167.68 --port 2886
[2024-07-02 11:55:59.209] [DEBUG] – exited code 0
[2024-07-02 11:55:59.210] [INFO] observer program health check
[2024-07-02 11:56:02.214] [DEBUG] – 149.0.167.68 program health check
[2024-07-02 11:56:02.214] [DEBUG] – root@149.0.167.68 execute: cat /dbdata/myoceanbase/oceanbase/run/observer.pid
[2024-07-02 11:56:02.219] [DEBUG] – exited code 0
[2024-07-02 11:56:02.220] [DEBUG] – root@149.0.167.68 execute: ls /proc/12561
[2024-07-02 11:56:02.266] [DEBUG] – exited code 0
[2024-07-02 11:56:02.267] [DEBUG] – 149.0.167.68 observer[pid: 12561] started
[2024-07-02 11:56:02.336] [INFO] obshell program health check
[2024-07-02 11:56:02.337] [DEBUG] – root@149.0.167.68 execute: cat /dbdata/myoceanbase/oceanbase/run/obshell.pid
[2024-07-02 11:56:02.342] [DEBUG] – exited code 0
[2024-07-02 11:56:02.342] [DEBUG] – root@149.0.167.68 execute: ls /proc/12655
[2024-07-02 11:56:02.390] [DEBUG] – exited code 0
[2024-07-02 11:56:02.390] [DEBUG] – 149.0.167.68 obshell[pid: 12655] started
[2024-07-02 11:56:02.467] [DEBUG] – need_bootstrap: False
[2024-07-02 11:56:02.468] [DEBUG] - sub start ref count to 0
[2024-07-02 11:56:02.468] [DEBUG] - export start
[2024-07-02 11:56:02.468] [DEBUG] - Call oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.0.1-100000242024032211.el8-f0165daceff0ec4a1074bd50fd15e887082e9bd9
[2024-07-02 11:56:02.468] [DEBUG] - import connect
[2024-07-02 11:56:02.580] [DEBUG] - add connect ref count to 1
[2024-07-02 11:56:02.581] [DEBUG] – connect obshell (149.0.167.68:2886)
[2024-07-02 11:56:02.581] [INFO] Connect to observer
[2024-07-02 11:56:02.582] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:56:05.586] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:56:08.590] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:56:11.594] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:56:14.596] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:56:17.599] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:56:20.603] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:56:23.608] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:56:26.612] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:56:29.614] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:56:32.618] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:56:35.623] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:56:38.627] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:56:41.632] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:56:44.634] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:56:47.639] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:56:50.642] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:56:53.644] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:56:56.646] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:56:59.651] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:57:02.655] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:57:05.660] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:57:08.662] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:57:11.665] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:57:14.666] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:57:17.670] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:57:20.673] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:57:23.677] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p

[2024-07-02 11:58:38.766] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:58:41.769] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:58:44.774] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:58:47.775] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:58:50.780] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:58:53.782] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:58:56.786] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:58:59.788] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 11:59:02.792] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -piH(2EwqzU([0t[]x
[2024-07-02 11:59:05.796] [DEBUG] – connect 149.0.167.68 -P2881 -uroot -p
[2024-07-02 12:01:02.927] [ERROR] Traceback (most recent call last):
[2024-07-02 12:01:02.928] [ERROR] File “core.py”, line 2058, in start_cluster
[2024-07-02 12:01:02.928] [ERROR] File “core.py”, line 2158, in _start_cluster
[2024-07-02 12:01:02.928] [ERROR] File “core.py”, line 197, in call_plugin
[2024-07-02 12:01:02.928] [ERROR] File “_plugin.py”, line 347, in call
[2024-07-02 12:01:02.928] [ERROR] File “_plugin.py”, line 305, in _new_func
[2024-07-02 12:01:02.928] [ERROR] File “/root/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 625, in connect
[2024-07-02 12:01:02.928] [ERROR] cursor = Cursor(ip=server.ip, port=server_config[‘mysql_port’], tenant=’’, password=password if password is not None else ‘’, stdio=stdio)
[2024-07-02 12:01:02.928] [ERROR] File “_stdio.py”, line 908, in wrapper
[2024-07-02 12:01:02.928] [ERROR] File “/root/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 517, in init
[2024-07-02 12:01:02.928] [ERROR] self._connect()
[2024-07-02 12:01:02.928] [ERROR] File “/root/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 547, in _connect
[2024-07-02 12:01:02.928] [ERROR] self.db = mysql.connect(host=self.ip, user=self.user, port=int(self.port), password=str(self.password),
[2024-07-02 12:01:02.928] [ERROR] File “pymysql/connections.py”, line 353, in init
[2024-07-02 12:01:02.928] [ERROR] File “pymysql/connections.py”, line 633, in connect
[2024-07-02 12:01:02.928] [ERROR] File “pymysql/connections.py”, line 907, in _request_authentication
[2024-07-02 12:01:02.928] [ERROR] File “pymysql/connections.py”, line 725, in _read_packet
[2024-07-02 12:01:02.928] [ERROR] File “pymysql/protocol.py”, line 221, in raise_for_error
[2024-07-02 12:01:02.928] [ERROR] File “pymysql/err.py”, line 143, in raise_mysql_exception
[2024-07-02 12:01:02.928] [ERROR] pymysql.err.OperationalError: (1045, “Access denied for user ‘root’@‘xxx.xxx.xxx.xxx’ (using password: YES)”)
[2024-07-02 12:01:02.928] [ERROR]
[2024-07-02 12:01:05.930] [ERROR] OBD-1006: Failed to connect to oceanbase-ce
[2024-07-02 12:01:05.931] [DEBUG] - sub connect ref count to 0
[2024-07-02 12:01:05.931] [DEBUG] - export connect
[2024-07-02 12:01:05.932] [INFO] See OceanBase分布式数据库-海量数据 笔笔算数 .
[2024-07-02 12:01:05.932] [INFO] Trace ID: fa332792-3826-11ef-bfc8-0242c0d94554
[2024-07-02 12:01:05.932] [INFO] If you want to view detailed obd logs, please run: obd display-trace fa332792-3826-11ef-bfc8-0242c0d94554
[2024-07-02 12:01:05.933] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 3
[2024-07-02 12:01:05.933] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 2
[2024-07-02 12:01:05.933] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 1
[2024-07-02 12:01:05.933] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 0
[2024-07-02 12:01:05.933] [DEBUG] - unlock /root/.obd/lock/mirror_and_repo
[2024-07-02 12:01:05.933] [DEBUG] - exclusive lock /root/.obd/lock/deploy_myoceanbase release, count 0
[2024-07-02 12:01:05.933] [DEBUG] - unlock /root/.obd/lock/deploy_myoceanbase
[2024-07-02 12:01:05.933] [DEBUG] - share lock /root/.obd/lock/global release, count 0
[2024-07-02 12:01:05.933] [DEBUG] - unlock /root/.obd/lock/global

root@167-68:/dbdata/myoceanbase# ps -ef|grep observer
root 12561 1 45 11:55 ? 01:39:33 /dbdata/myoceanbase/oceanbase/bin/observer -r 149.0.167.68:2882:2881 -p 2881 -P 2882 -z zone1 -n myoceanbase -c 1717471694 -d /dbdata/myoceanbase/oceanbase/store -I 149.0.167.68 -o __min_full_resource_pool_memory=2147483648,enable_syslog_recycle=True,enable_syslog_wf=False,max_syslog_file_count=4,memory_limit=445G,datafile_size=1336G,system_memory=55296M,log_disk_size=1228G,cpu_count=94,datafile_maxsize=22265G,datafile_next=2227G
root 42534 11530 0 15:35 pts/0 00:00:00 grep observer

我印象中是没有执行过修改密码,不清楚有其他同事执行过没有,密码错误导致连接不上的原因吗?

日志中存在密码连接失败问题 obd搭建的集群需要用obd edit-config来修改,如果使用alter修改会导致obd不承认密码已被修改。可以先询问一下同事是否有人改过密码

我问了下好像都没有修改过密码,也有可能修改了忘记了,有办法重置吗?

iH(2EwqzU([0t[]x 试一下能不能用这个密码连接试试。如果不行,用你们现在的密码登陆进去修改为这个密码后续再使用obd cluster edit-config 修改密码

1 个赞

看起来是密码问题,
1.你的observer是正常启动的
2.取下/home/admin/.obd/cluster/集群名称/config.yaml

2 个赞

config.zip (1017 字节)

尝试出修改的密码了,现在服务正常启动,感谢老师!麻烦了。

感谢老师!麻烦了。