使用oceanbase-all-in-one-4.3.3_20241014.el8.x86_64.tar.gz在多网卡黑屏部署yaml文件时指定其中一个ip和devname后，部署失败报：Cluster init failed。指定另一个ip和devname却能部署成功。

OceanBase 技术问题
#14

进程存在说明ob已经启动成功了可以试试黑屏化连接，报错是connect超时么？

#15

[sys@e107 ~]$ mysql -h10.99.88.107 -P2881 -uroot@sys -p******* -Doceanbase -A
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 3221487626
Server version: 5.7.25 OceanBase_CE 4.3.3.0 (r100000142024101215-0723f9774e5f77a1253149261ba75a94414625d0) (Built Oct 12 2024 16:04:08)

Copyright (c) 2000, 2024, Oracle and/or its affiliates.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type ‘help;’ or ‘\h’ for help. Type ‘\c’ to clear the current input statement.

mysql> show databases;
±-------------------+
| Database |
±-------------------+
| information_schema |
| LBACSYS |
| mysql |
| oceanbase |
| ocs |
| ORAAUDITOR |
| SYS |
| sys_external_tbs |
| test |
±-------------------+
9 rows in set (0.01 sec)

mysql> select * from dba_ob_tenants\G
*************************** 1. row ***************************
TENANT_ID: 1
TENANT_NAME: sys
TENANT_TYPE: SYS
CREATE_TIME: 2025-01-03 10:58:32.303109
MODIFY_TIME: 2025-01-03 10:58:32.303109
PRIMARY_ZONE: RANDOM
LOCALITY: FULL{1}@zone1
PREVIOUS_LOCALITY: NULL
COMPATIBILITY_MODE: MYSQL
STATUS: NORMAL
IN_RECYCLEBIN: NO
LOCKED: NO
TENANT_ROLE: PRIMARY
SWITCHOVER_STATUS: NORMAL
SWITCHOVER_EPOCH: 0
SYNC_SCN: NULL
REPLAYABLE_SCN: NULL
READABLE_SCN: NULL
RECOVERY_UNTIL_SCN: NULL
LOG_MODE: NOARCHIVELOG
ARBITRATION_SERVICE_STATUS: DISABLED
UNIT_NUM: 1
COMPATIBLE: 4.3.3.0
MAX_LS_ID: 1
RESTORE_DATA_MODE: NORMAL
1 row in set (0.03 sec)

mysql>

#16

sys租户已经能登陆进行查询了

#17

但是obd中控机报部署错误
[2025-01-03 10:58:38.962] [DEBUG] – osys@100.99.88.107 execute: cd /observer/oceanbase; /observer/oceanbase/bin/obshell admin start --ip 100.99.88.107 --port 2886
[2025-01-03 10:58:43.177] [DEBUG] – exited code 0
[2025-01-03 10:58:46.181] [DEBUG] – send request to obshell: method: GET, url: /api/v1/status, data: {}, headers: None, params: None
[2025-01-03 10:58:58.045] [ERROR] response parser error: Expecting value: line 1 column 1 (char 0)
[2025-01-03 10:58:58.046] [ERROR] oceanbase-ce-py_script_bootstrap-4.2.2.0 RuntimeError: ‘NoneType’ object has no attribute ‘code’
[2025-01-03 10:58:58.046] [ERROR] Traceback (most recent call last):
[2025-01-03 10:58:58.046] [ERROR] File “core.py”, line 2104, in start_cluster
[2025-01-03 10:58:58.046] [ERROR] File “core.py”, line 2209, in _start_cluster
[2025-01-03 10:58:58.046] [ERROR] File “core.py”, line 198, in call_plugin
[2025-01-03 10:58:58.046] [ERROR] File “_plugin.py”, line 348, in call
[2025-01-03 10:58:58.046] [ERROR] File “_plugin.py”, line 305, in _new_func
[2025-01-03 10:58:58.046] [ERROR] File “/home/osys/.obd/plugins/oceanbase-ce/4.2.2.0/bootstrap.py”, line 167, in bootstrap
[2025-01-03 10:58:58.046] [ERROR] status = ocs_cursor[server].status_request(ignore_ConnectionError=True)
[2025-01-03 10:58:58.046] [ERROR] File “/home/osys/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 412, in status_request
[2025-01-03 10:58:58.046] [ERROR] resp = self.request(‘GET’, ‘/api/v1/status’, ignore_ConnectionError=ignore_ConnectionError)
[2025-01-03 10:58:58.047] [ERROR] File “/home/sys/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 381, in request
[2025-01-03 10:58:58.047] [ERROR] return self._request(method, url, data, headers, params, ignore_ConnectionError=ignore_ConnectionError, *args, **kwargs)
[2025-01-03 10:58:58.047] [ERROR] File “/home/osys/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 335, in _request
[2025-01-03 10:58:58.047] [ERROR] if parsed_resp.code != 200:
[2025-01-03 10:58:58.047] [ERROR] AttributeError: ‘NoneType’ object has no attribute ‘code’
[2025-01-03 10:58:58.047] [ERROR]
[2025-01-03 10:58:58.047] [DEBUG] - sub bootstrap ref count to 0
[2025-01-03 10:58:58.047] [DEBUG] - export bootstrap
[2025-01-03 10:58:58.047] [DEBUG] - plugin oceanbase-ce-py_script_bootstrap-4.2.2.0 result: False
[2025-01-03 10:58:58.047] [INFO] [ERROR] response parser error: Expecting value: line 1 column 1 (char 0)
[2025-01-03 10:58:58.047] [INFO] [ERROR] oceanbase-ce-py_script_bootstrap-4.2.2.0 RuntimeError: ‘NoneType’ object has no attribute ‘code’
[2025-01-03 10:58:58.047] [INFO]
[2025-01-03 10:58:58.047] [ERROR] Cluster init failed
[2025-01-03 10:58:58.051] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes .
[2025-01-03 10:58:58.051] [INFO] Trace ID: 79c2f5a8-c97e-11ef-94b1-bc24114b410f
[2025-01-03 10:58:58.051] [INFO] If you want to view detailed obd logs, please run: obd display-trace 79c2f5a8-c97e-11ef-94b1-bc24114b410f
[2025-01-03 10:58:58.052] [DEBUG] - unlock /home/osys/.obd/lock/global
[2025-01-03 10:58:58.052] [DEBUG] - unlock /home/osys/.obd/lock/deploy_cnfnms_ob
[2025-01-03 10:58:58.052] [DEBUG] - unlock /home/osys/.obd/lock/mirror_and_repo

#18

看log是connect.py出错了
.obd/plugins/oceanbase-ce/4.2.2.0/connect.py", line 381, in request
[2025-01-03 10:58:58.047] [ERROR] return self._request(method, url, data, headers, params, ignore_ConnectionError=ignore_ConnectionError, *args, **kwargs)
[2025-01-03 10:58:58.047] [ERROR] File “/home/opesys/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 335, in _request
[2025-01-03 10:58:58.047] [ERROR] if parsed_resp.code != 200:
[2025-01-03 10:58:58.047] [ERROR] AttributeError: ‘NoneType’ object has no attribute ‘code’

#19

按照楼上

image
image940×184 9.15 KB

所说的把local_ip加进去，也是相同的报错。下面是.obd/cluster/***/config.yaml文件，麻烦帮忙看下是否哪里配置不对？

image
image780×693 14.4 KB

#20

把local_ip改成ip

#21

一开始就是ip，今天改成local_ip，报错都是一样的

#22

看报错是和这篇帖子一样的 obd demo部署报错 - #5，来自 王利博

#23

参考这种写法
image

server1:
·······
local_ip：
把你的global中这些删除

#24

还是一样的错误，下面是我按照您的建议修改的config.yaml文件和log

image

[opesys@localhost ~]$ obd cluster deploy testapp100 -c /home/opesys/myconfig100.yaml
±-------------------------------------------------------------------------------------------+
| Packages |
±-------------±--------±-----------------------±-----------------------------------------+
| Repository | Version | Release | Md5 |
±-------------±--------±-----------------------±-----------------------------------------+
| oceanbase-ce | 4.3.3.0 | 100000142024101215.el8 | 3eee13839888800065c13ffc5cd7c3e6b12cb55c |
| obagent | 4.2.2 | 100000042024011120.el8 | bf152b880953c2043ddaf80d6180cf22bb8c8ac2 |
±-------------±--------±-----------------------±-----------------------------------------+
Repository integrity check ok
Load param plugin ok
Open ssh connection ok
Parameter check ok
Cluster status check ok
Initializes observer work home ok
Initializes obagent work home ok
Remote oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c repository install ok
Remote oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c repository lib check !!
Remote obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2 repository install ok
Remote obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2 repository lib check ok
Try to get lib-repository
Remote oceanbase-ce-libs-4.3.3.0-100000142024101215.el8-e7a3b95e149ceb82ba975bb623e63b4becb6b698 repository install ok
Remote oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c repository lib check ok
testapp100 deployed
Please execute obd cluster start testapp100 to start
Trace ID: ab48ea50-c9a2-11ef-ac43-bc24114b410f
If you want to view detailed obd logs, please run: obd display-trace ab48ea50-c9a2-11ef-ac43-bc24114b410f
[opesys@localhost ~]$ obd cluster start testapp100
Get local repositories ok
Search plugins ok
Load cluster param plugin ok
Open ssh connection ok
Check before start observer ok
[WARN] OBD-1012: (100.99.88.107) clog and data use the same disk (/)

Check before start obagent ok
cluster scenario: htap
Start observer ok
observer program health check ok
Connect to observer 100.99.88.107:2881 ok
Initialize oceanbase-ce |Traceback (most recent call last):
File “/home/opesys/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 355, in _response_parser
data = resp.json()
File “requests/models.py”, line 900, in json
File “json/init.py”, line 357, in loads
File “json/decoder.py”, line 337, in decode
File “json/decoder.py”, line 355, in raw_decode
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
Initialize oceanbase-ce x
[ERROR] response parser error: Expecting value: line 1 column 1 (char 0)
[ERROR] oceanbase-ce-py_script_bootstrap-4.2.2.0 RuntimeError: ‘NoneType’ object has no attribute ‘code’

[ERROR] Cluster init failed
See https://www.oceanbase.com/product/ob-deployer/error-codes .
Trace ID: b4273d0c-c9a2-11ef-a1ba-bc24114b410f
If you want to view detailed obd logs, please run: obd display-trace b4273d0c-c9a2-11ef-a1ba-bc24114b410f
[opesys@localhost ~]$
[opesys@localhost ~]$
[opesys@localhost ~]$
[opesys@localhost ~]$
[opesys@localhost ~]$
[opesys@localhost ~]$ obd display-trace b4273d0c-c9a2-11ef-a1ba-bc24114b410f
[2025-01-03 15:16:51.613] [DEBUG] - cmd: [‘testapp100’]
[2025-01-03 15:16:51.613] [DEBUG] - opts: {‘servers’: None, ‘components’: None, ‘force_delete’: None, ‘strict_check’: None, ‘without_parameter’: None}
[2025-01-03 15:16:51.613] [DEBUG] - mkdir /home/opesys/.obd/lock/
[2025-01-03 15:16:51.614] [DEBUG] - unknown lock mode
[2025-01-03 15:16:51.614] [DEBUG] - try to get share lock /home/opesys/.obd/lock/global
[2025-01-03 15:16:51.614] [DEBUG] - share lock /home/opesys/.obd/lock/global, count 1
[2025-01-03 15:16:51.614] [DEBUG] - Get Deploy by name
[2025-01-03 15:16:51.614] [DEBUG] - mkdir /home/opesys/.obd/cluster/
[2025-01-03 15:16:51.615] [DEBUG] - mkdir /home/opesys/.obd/config_parser/
[2025-01-03 15:16:51.615] [DEBUG] - try to get exclusive lock /home/opesys/.obd/lock/deploy_testapp100
[2025-01-03 15:16:51.615] [DEBUG] - exclusive lock /home/opesys/.obd/lock/deploy_testapp100, count 1
[2025-01-03 15:16:51.621] [DEBUG] - Deploy status judge
[2025-01-03 15:16:51.621] [INFO] Get local repositories
[2025-01-03 15:16:51.622] [DEBUG] - mkdir /home/opesys/.obd/repository
[2025-01-03 15:16:51.622] [DEBUG] - Get local repository oceanbase-ce-4.3.3.0-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:51.622] [DEBUG] - Search repository oceanbase-ce version: 4.3.3.0, tag: 3eee13839888800065c13ffc5cd7c3e6b12cb55c, release: None, package_hash: None
[2025-01-03 15:16:51.623] [DEBUG] - try to get share lock /home/opesys/.obd/lock/mirror_and_repo
[2025-01-03 15:16:51.623] [DEBUG] - share lock /home/opesys/.obd/lock/mirror_and_repo, count 1
[2025-01-03 15:16:51.623] [DEBUG] - mkdir /home/opesys/.obd/repository/oceanbase-ce
[2025-01-03 15:16:51.625] [DEBUG] - Found repository oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:51.625] [DEBUG] - Get local repository obagent-4.2.2-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:51.625] [DEBUG] - Search repository obagent version: 4.2.2, tag: bf152b880953c2043ddaf80d6180cf22bb8c8ac2, release: None, package_hash: None
[2025-01-03 15:16:51.625] [DEBUG] - share lock /home/opesys/.obd/lock/mirror_and_repo, count 2
[2025-01-03 15:16:51.625] [DEBUG] - mkdir /home/opesys/.obd/repository/obagent
[2025-01-03 15:16:51.627] [DEBUG] - Found repository obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:51.753] [DEBUG] - Get deploy config
[2025-01-03 15:16:51.769] [INFO] Search plugins
[2025-01-03 15:16:51.770] [DEBUG] - Searching start_check plugin for components …
[2025-01-03 15:16:51.770] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:51.770] [DEBUG] - mkdir /home/opesys/.obd/plugins
[2025-01-03 15:16:51.771] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.3.0.0 for oceanbase-ce-4.3.3.0
[2025-01-03 15:16:51.772] [DEBUG] - Searching start_check plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:51.772] [DEBUG] - Found for obagent-py_script_start_check-4.2.2 for obagent-4.2.2
[2025-01-03 15:16:51.772] [DEBUG] - Searching create_tenant plugin for components …
[2025-01-03 15:16:51.772] [DEBUG] - Searching create_tenant plugin for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:51.773] [DEBUG] - Found for oceanbase-ce-py_script_create_tenant-4.3.0.0 for oceanbase-ce-4.3.3.0
[2025-01-03 15:16:51.773] [DEBUG] - Searching create_tenant plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:51.773] [DEBUG] - No such create_tenant plugin for obagent-4.2.2
[2025-01-03 15:16:51.773] [DEBUG] - Searching tenant_optimize plugin for components …
[2025-01-03 15:16:51.773] [DEBUG] - Searching tenant_optimize plugin for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:51.774] [DEBUG] - Found for oceanbase-ce-py_script_tenant_optimize-4.3.0.0 for oceanbase-ce-4.3.3.0
[2025-01-03 15:16:51.774] [DEBUG] - Searching tenant_optimize plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:51.774] [DEBUG] - No such tenant_optimize plugin for obagent-4.2.2
[2025-01-03 15:16:51.774] [DEBUG] - Searching start plugin for components …
[2025-01-03 15:16:51.774] [DEBUG] - Searching start plugin for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:51.775] [DEBUG] - Found for oceanbase-ce-py_script_start-4.3.0.0 for oceanbase-ce-4.3.3.0
[2025-01-03 15:16:51.775] [DEBUG] - Searching start plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:51.775] [DEBUG] - Found for obagent-py_script_start-4.2.2 for obagent-4.2.2
[2025-01-03 15:16:51.775] [DEBUG] - Searching connect plugin for components …
[2025-01-03 15:16:51.775] [DEBUG] - Searching connect plugin for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:51.776] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.3.0
[2025-01-03 15:16:51.776] [DEBUG] - Searching connect plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:51.776] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-4.2.2
[2025-01-03 15:16:51.776] [DEBUG] - Searching bootstrap plugin for components …
[2025-01-03 15:16:51.776] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:51.777] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.2.2.0 for oceanbase-ce-4.3.3.0
[2025-01-03 15:16:51.777] [DEBUG] - Searching bootstrap plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:51.777] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-4.2.2
[2025-01-03 15:16:51.777] [DEBUG] - Searching display plugin for components …
[2025-01-03 15:16:51.777] [DEBUG] - Searching display plugin for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:51.778] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.3.3.0
[2025-01-03 15:16:51.778] [DEBUG] - Searching display plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:51.778] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-4.2.2
[2025-01-03 15:16:51.901] [INFO] Load cluster param plugin
[2025-01-03 15:16:51.902] [DEBUG] - Get local repository oceanbase-ce-4.3.3.0-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:51.902] [DEBUG] - Get local repository obagent-4.2.2-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:51.902] [DEBUG] - Searching param plugin for components …
[2025-01-03 15:16:51.902] [DEBUG] - Search param plugin for oceanbase-ce
[2025-01-03 15:16:51.903] [DEBUG] - Found for oceanbase-ce-param-4.3.3.0 for oceanbase-ce-4.3.3.0
[2025-01-03 15:16:51.903] [DEBUG] - Applying oceanbase-ce-param-4.3.3.0 for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:52.451] [DEBUG] - Search param plugin for obagent
[2025-01-03 15:16:52.452] [DEBUG] - Found for obagent-param-4.2.2 for obagent-4.2.2
[2025-01-03 15:16:52.452] [DEBUG] - Applying obagent-param-4.2.2 for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:52.635] [INFO] Open ssh connection
[2025-01-03 15:16:52.640] [DEBUG] - host: 100.99.88.107, port: 22, user: opesys, password: None
[2025-01-03 15:16:52.983] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.3.0.0 for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:52.983] [DEBUG] - import start_check
[2025-01-03 15:16:52.992] [DEBUG] - add start_check ref count to 1
[2025-01-03 15:16:52.992] [INFO] Check before start observer
[2025-01-03 15:16:52.994] [DEBUG] – opesys@100.99.88.107 execute: ls /observer/store/data/clog/tenant_1/
[2025-01-03 15:16:53.016] [DEBUG] – exited code 2, error output:
[2025-01-03 15:16:53.016] [DEBUG] ls: 无法访问’/observer/store/data/clog/tenant_1/’: 没有那个文件或目录
[2025-01-03 15:16:53.016] [DEBUG]
[2025-01-03 15:16:53.017] [DEBUG] – opesys@100.99.88.107 execute: cat /observer/oceanbase/run/observer.pid
[2025-01-03 15:16:53.079] [DEBUG] – exited code 1, error output:
[2025-01-03 15:16:53.080] [DEBUG] cat: /observer/oceanbase/run/observer.pid: 没有那个文件或目录
[2025-01-03 15:16:53.080] [DEBUG]
[2025-01-03 15:16:53.080] [DEBUG] – 100.99.88.107 port check
[2025-01-03 15:16:53.080] [DEBUG] – opesys@100.99.88.107 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B41’ | awk -F’ ’ ‘{print $3}’ | uniq
[2025-01-03 15:16:53.147] [DEBUG] – exited code 0
[2025-01-03 15:16:53.147] [DEBUG] – opesys@100.99.88.107 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B42’ | awk -F’ ’ ‘{print $3}’ | uniq
[2025-01-03 15:16:53.215] [DEBUG] – exited code 0
[2025-01-03 15:16:53.215] [DEBUG] – opesys@100.99.88.107 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:0B46’ | awk -F’ ’ ‘{print $3}’ | uniq
[2025-01-03 15:16:53.283] [DEBUG] – exited code 0
[2025-01-03 15:16:53.284] [DEBUG] – opesys@100.99.88.107 execute: ls /observer/store/data/sstable/block_file
[2025-01-03 15:16:53.346] [DEBUG] – exited code 2, error output:
[2025-01-03 15:16:53.346] [DEBUG] ls: 无法访问’/observer/store/data/sstable/block_file’: 没有那个文件或目录
[2025-01-03 15:16:53.346] [DEBUG]
[2025-01-03 15:16:53.347] [DEBUG] – opesys@100.99.88.107 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr
[2025-01-03 15:16:53.409] [DEBUG] – exited code 0
[2025-01-03 15:16:53.409] [DEBUG] – opesys@100.99.88.107 execute: ulimit -a
[2025-01-03 15:16:53.469] [DEBUG] – exited code 0
[2025-01-03 15:16:53.470] [DEBUG] – opesys@100.99.88.107 execute: sysctl -a
[2025-01-03 15:16:53.548] [DEBUG] – exited code 0
[2025-01-03 15:16:53.551] [DEBUG] – opesys@100.99.88.107 execute: cat /proc/meminfo
[2025-01-03 15:16:53.609] [DEBUG] – exited code 0
[2025-01-03 15:16:53.610] [DEBUG] – opesys@100.99.88.107 execute: df --block-size=1024
[2025-01-03 15:16:53.671] [DEBUG] – exited code 0
[2025-01-03 15:16:53.672] [DEBUG] – get disk info for path /dev, total: 33599291392 avail: 33599291392
[2025-01-03 15:16:53.672] [DEBUG] – get disk info for path /dev/shm, total: 33619066880 avail: 33619066880
[2025-01-03 15:16:53.672] [DEBUG] – get disk info for path /run, total: 33619066880 avail: 33593139200
[2025-01-03 15:16:53.672] [DEBUG] – get disk info for path /sys/fs/cgroup, total: 33619066880 avail: 33619066880
[2025-01-03 15:16:53.673] [DEBUG] – get disk info for path /, total: 203911331840 avail: 184771293184
[2025-01-03 15:16:53.673] [DEBUG] – get disk info for path /boot, total: 4284481536 avail: 4055883776
[2025-01-03 15:16:53.673] [DEBUG] – get disk info for path /oceanbase, total: 107321753600 avail: 106539302912
[2025-01-03 15:16:53.673] [DEBUG] – get disk info for path /run/user/1000, total: 6723813376 avail: 6723813376
[2025-01-03 15:16:53.673] [DEBUG] – opesys@100.99.88.107 execute: df --block-size=1024 /observer/store/data
[2025-01-03 15:16:53.733] [DEBUG] – exited code 0
[2025-01-03 15:16:53.733] [DEBUG] – get disk info for path /, total: 203911331840 avail: 184771293184
[2025-01-03 15:16:53.733] [DEBUG] – opesys@100.99.88.107 execute: df --block-size=1024 /observer/store/redo/clog
[2025-01-03 15:16:53.794] [DEBUG] – exited code 0
[2025-01-03 15:16:53.794] [DEBUG] – get disk info for path /, total: 203911331840 avail: 184771293184
[2025-01-03 15:16:53.794] [DEBUG] – disk: {’/dev’: {‘total’: 33599291392, ‘avail’: 33599291392, ‘need’: 0}, ‘/dev/shm’: {‘total’: 33619066880, ‘avail’: 33619066880, ‘need’: 0}, ‘/run’: {‘total’: 33619066880, ‘avail’: 33593139200, ‘need’: 0}, ‘/sys/fs/cgroup’: {‘total’: 33619066880, ‘avail’: 33619066880, ‘need’: 0}, ‘/’: {‘total’: 203911331840, ‘avail’: 184771293184, ‘need’: 0}, ‘/boot’: {‘total’: 4284481536, ‘avail’: 4055883776, ‘need’: 0}, ‘/oceanbase’: {‘total’: 107321753600, ‘avail’: 106539302912, ‘need’: 0}, ‘/run/user/1000’: {‘total’: 6723813376, ‘avail’: 6723813376, ‘need’: 0}}
[2025-01-03 15:16:53.795] [WARNING] OBD-1012: (100.99.88.107) clog and data use the same disk (/)
[2025-01-03 15:16:53.795] [DEBUG] – opesys@100.99.88.107 execute: ping -W 1 -c 1 127.0.0.1
[2025-01-03 15:16:53.856] [DEBUG] – exited code 0
[2025-01-03 15:16:53.856] [DEBUG] – opesys@100.99.88.107 execute: date +%s%N
[2025-01-03 15:16:53.917] [DEBUG] – exited code 0
[2025-01-03 15:16:53.917] [DEBUG] – 100.99.88.107 time delta 28.945556640625
[2025-01-03 15:16:54.038] [INFO] [WARN] OBD-1012: (100.99.88.107) clog and data use the same disk (/)
[2025-01-03 15:16:54.038] [INFO]
[2025-01-03 15:16:54.038] [DEBUG] - sub start_check ref count to 0
[2025-01-03 15:16:54.039] [DEBUG] - export start_check
[2025-01-03 15:16:54.039] [DEBUG] - plugin oceanbase-ce-py_script_start_check-4.3.0.0 result: True
[2025-01-03 15:16:54.039] [DEBUG] - Call obagent-py_script_start_check-4.2.2 for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:16:54.039] [DEBUG] - import start_check
[2025-01-03 15:16:54.041] [DEBUG] - add start_check ref count to 1
[2025-01-03 15:16:54.041] [INFO] Check before start obagent
[2025-01-03 15:16:54.043] [DEBUG] – opesys@100.99.88.107 execute: cat /observer/obagent/run/ob_agentd.pid
[2025-01-03 15:16:54.066] [DEBUG] – exited code 1, error output:
[2025-01-03 15:16:54.066] [DEBUG] cat: /observer/obagent/run/ob_agentd.pid: 没有那个文件或目录
[2025-01-03 15:16:54.066] [DEBUG]
[2025-01-03 15:16:54.067] [DEBUG] – 100.99.88.107 port check
[2025-01-03 15:16:54.067] [DEBUG] – opesys@100.99.88.107 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:1F99’ | awk -F’ ’ ‘{print $3}’ | uniq
[2025-01-03 15:16:54.136] [DEBUG] – exited code 0
[2025-01-03 15:16:54.136] [DEBUG] – opesys@100.99.88.107 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{if($4==“0A”) print $2,$4,$10}’ | grep ‘:1F98’ | awk -F’ ’ ‘{print $3}’ | uniq
[2025-01-03 15:16:54.204] [DEBUG] – exited code 0
[2025-01-03 15:16:54.305] [DEBUG] - sub start_check ref count to 0
[2025-01-03 15:16:54.305] [DEBUG] - export start_check
[2025-01-03 15:16:54.305] [DEBUG] - plugin obagent-py_script_start_check-4.2.2 result: True
[2025-01-03 15:16:54.306] [DEBUG] - Call oceanbase-ce-py_script_start-4.3.0.0 for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:54.306] [DEBUG] - import start
[2025-01-03 15:16:54.308] [DEBUG] - add start ref count to 1
[2025-01-03 15:16:54.309] [INFO] cluster scenario: htap
[2025-01-03 15:16:54.309] [INFO] Start observer
[2025-01-03 15:16:54.310] [DEBUG] – opesys@100.99.88.107 execute: ls /observer/store/data/clog/tenant_1/
[2025-01-03 15:16:54.332] [DEBUG] – exited code 2, error output:
[2025-01-03 15:16:54.332] [DEBUG] ls: 无法访问’/observer/store/data/clog/tenant_1/’: 没有那个文件或目录
[2025-01-03 15:16:54.332] [DEBUG]
[2025-01-03 15:16:54.332] [DEBUG] – opesys@100.99.88.107 execute: cat /observer/oceanbase/run/observer.pid
[2025-01-03 15:16:54.393] [DEBUG] – exited code 1, error output:
[2025-01-03 15:16:54.394] [DEBUG] cat: /observer/oceanbase/run/observer.pid: 没有那个文件或目录
[2025-01-03 15:16:54.394] [DEBUG]
[2025-01-03 15:16:54.394] [DEBUG] – 100.99.88.107 start command construction
[2025-01-03 15:16:54.394] [DEBUG] – update large_query_threshold to 600s because of scenario
[2025-01-03 15:16:54.394] [DEBUG] – update enable_syslog_recycle to 1 because of scenario
[2025-01-03 15:16:54.395] [DEBUG] – update max_syslog_file_count to 300 because of scenario
[2025-01-03 15:16:54.395] [DEBUG] – starting 100.99.88.107 observer
[2025-01-03 15:16:54.395] [DEBUG] – opesys@100.99.88.107 export LD_LIBRARY_PATH=’/observer/oceanbase/lib:’
[2025-01-03 15:16:54.395] [DEBUG] – opesys@100.99.88.107 execute: cd /observer/oceanbase; /observer/oceanbase/bin/observer -r ‘100.99.88.107:2882:2881’ -p 2881 -P 2882 -z ‘zone1’ -n ‘testapp’ -c 1 -d ‘/observer/store/data’ -l ‘WARN’ -I ‘100.99.88.107’ -o __min_full_resource_pool_memory=2147483648,memory_limit=‘8G’,system_memory=‘1G’,datafile_size=‘2G’,datafile_next=‘2G’,datafile_maxsize=‘20G’,log_disk_size=‘20G’,cpu_count=8,enable_syslog_wf=False,max_syslog_file_count=4,enable_syslog_recycle=True,large_query_threshold=‘600s’
[2025-01-03 15:16:54.532] [DEBUG] – exited code 0
[2025-01-03 15:16:54.533] [DEBUG] – opesys@100.99.88.107 delete env LD_LIBRARY_PATH
[2025-01-03 15:16:54.571] [DEBUG] – start_obshell: False
[2025-01-03 15:16:54.571] [INFO] observer program health check
[2025-01-03 15:16:57.575] [DEBUG] – 100.99.88.107 program health check
[2025-01-03 15:16:57.575] [DEBUG] – opesys@100.99.88.107 execute: cat /observer/oceanbase/run/observer.pid
[2025-01-03 15:16:57.597] [DEBUG] – exited code 0
[2025-01-03 15:16:57.597] [DEBUG] – opesys@100.99.88.107 execute: ls /proc/311722
[2025-01-03 15:16:57.659] [DEBUG] – exited code 0
[2025-01-03 15:16:57.660] [DEBUG] – 100.99.88.107 observer[pid: 311722] started
[2025-01-03 15:16:57.702] [DEBUG] – need_bootstrap: True
[2025-01-03 15:16:57.702] [DEBUG] - sub start ref count to 0
[2025-01-03 15:16:57.702] [DEBUG] - export start
[2025-01-03 15:16:57.703] [DEBUG] - plugin oceanbase-ce-py_script_start-4.3.0.0 result: True
[2025-01-03 15:16:57.703] [DEBUG] - Call oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:16:57.703] [DEBUG] - import connect
[2025-01-03 15:16:58.140] [DEBUG] - add connect ref count to 1
[2025-01-03 15:16:58.140] [DEBUG] – connect obshell (100.99.88.107:2886)
[2025-01-03 15:16:58.141] [INFO] Connect to observer
[2025-01-03 15:16:58.142] [DEBUG] – connect 100.99.88.107 -P2881 -uroot -p******
[2025-01-03 15:17:01.198] [DEBUG] – connect 100.99.88.107 -P2881 -uroot -p
[2025-01-03 15:17:01.204] [DEBUG] – execute sql: select 1. args: None
[2025-01-03 15:17:01.273] [DEBUG] - sub connect ref count to 0
[2025-01-03 15:17:01.273] [DEBUG] - export connect
[2025-01-03 15:17:01.274] [DEBUG] - plugin oceanbase-ce-py_script_connect-4.2.2.0 result: True
[2025-01-03 15:17:01.274] [INFO] Initialize oceanbase-ce
[2025-01-03 15:17:01.275] [DEBUG] - Call oceanbase-ce-py_script_bootstrap-4.2.2.0 for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:17:01.275] [DEBUG] - import bootstrap
[2025-01-03 15:17:01.279] [DEBUG] - add bootstrap ref count to 1
[2025-01-03 15:17:01.279] [DEBUG] – bootstrap for components: dict_keys([‘oceanbase-ce’, ‘obagent’])
[2025-01-03 15:17:01.279] [DEBUG] – execute sql: set session ob_query_timeout=1000000000
[2025-01-03 15:17:01.279] [DEBUG] – execute sql: set session ob_query_timeout=1000000000. args: None
[2025-01-03 15:17:01.281] [DEBUG] – execute sql: alter system bootstrap REGION “sys_region” ZONE “zone1” SERVER “100.99.88.107:2882”. args: None
[2025-01-03 15:17:59.149] [DEBUG] – execute sql: alter user “root” IDENTIFIED BY %s. args: [‘’]
[2025-01-03 15:17:59.206] [DEBUG] – execute sql: select * from oceanbase.__all_server. args: None
[2025-01-03 15:17:59.209] [DEBUG] – opesys@100.99.88.107 execute: ls /observer/oceanbase/.meta
[2025-01-03 15:17:59.231] [DEBUG] – exited code 2, error output:
[2025-01-03 15:17:59.231] [DEBUG] ls: 无法访问’/observer/oceanbase/.meta’: 没有那个文件或目录
[2025-01-03 15:17:59.231] [DEBUG]
[2025-01-03 15:17:59.231] [DEBUG] –
[2025-01-03 15:17:59.231] [DEBUG] – ls: 无法访问’/observer/oceanbase/.meta’: 没有那个文件或目录
[2025-01-03 15:17:59.232] [DEBUG]
[2025-01-03 15:17:59.232] [DEBUG] – opesys@100.99.88.107 execute: cat /observer/oceanbase/run/obshell.pid
[2025-01-03 15:17:59.292] [DEBUG] – exited code 1, error output:
[2025-01-03 15:17:59.292] [DEBUG] cat: /observer/oceanbase/run/obshell.pid: 没有那个文件或目录
[2025-01-03 15:17:59.292] [DEBUG]
[2025-01-03 15:17:59.292] [DEBUG] – opesys@100.99.88.107 execute: strings /observer/oceanbase/etc/observer.conf.bin
[2025-01-03 15:17:59.352] [DEBUG] – exited code 127, error output:
[2025-01-03 15:17:59.352] [DEBUG] bash: strings: 未找到命令
[2025-01-03 15:17:59.352] [DEBUG]
[2025-01-03 15:17:59.353] [DEBUG] –
[2025-01-03 15:17:59.353] [DEBUG] – bash: strings: 未找到命令
[2025-01-03 15:17:59.353] [DEBUG]
[2025-01-03 15:17:59.353] [DEBUG] – opesys@100.99.88.107 execute: cat /observer/oceanbase/run/obshell.pid
[2025-01-03 15:17:59.413] [DEBUG] – exited code 1, error output:
[2025-01-03 15:17:59.413] [DEBUG] cat: /observer/oceanbase/run/obshell.pid: 没有那个文件或目录
[2025-01-03 15:17:59.413] [DEBUG]
[2025-01-03 15:17:59.414] [DEBUG] – opesys@100.99.88.107 export OB_ROOT_PASSWORD=’'’’
[2025-01-03 15:17:59.414] [DEBUG] – start obshell: cd /observer/oceanbase; /observer/oceanbase/bin/obshell admin start --ip 100.99.88.107 --port 2886
[2025-01-03 15:17:59.414] [DEBUG] – opesys@100.99.88.107 execute: cd /observer/oceanbase; /observer/oceanbase/bin/obshell admin start --ip 100.99.88.107 --port 2886
[2025-01-03 15:18:03.673] [DEBUG] – exited code 0
[2025-01-03 15:18:06.677] [DEBUG] – send request to obshell: method: GET, url: /api/v1/status, data: {}, headers: None, params: None
[2025-01-03 15:18:22.893] [ERROR] response parser error: Expecting value: line 1 column 1 (char 0)
[2025-01-03 15:18:22.894] [ERROR] oceanbase-ce-py_script_bootstrap-4.2.2.0 RuntimeError: ‘NoneType’ object has no attribute ‘code’
[2025-01-03 15:18:22.894] [ERROR] Traceback (most recent call last):
[2025-01-03 15:18:22.894] [ERROR] File “core.py”, line 2104, in start_cluster
[2025-01-03 15:18:22.894] [ERROR] File “core.py”, line 2209, in _start_cluster
[2025-01-03 15:18:22.894] [ERROR] File “core.py”, line 198, in call_plugin
[2025-01-03 15:18:22.894] [ERROR] File “_plugin.py”, line 348, in call
[2025-01-03 15:18:22.894] [ERROR] File “_plugin.py”, line 305, in _new_func
[2025-01-03 15:18:22.894] [ERROR] File “/home/opesys/.obd/plugins/oceanbase-ce/4.2.2.0/bootstrap.py”, line 167, in bootstrap
[2025-01-03 15:18:22.894] [ERROR] status = ocs_cursor[server].status_request(ignore_ConnectionError=True)
[2025-01-03 15:18:22.894] [ERROR] File “/home/opesys/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 412, in status_request
[2025-01-03 15:18:22.894] [ERROR] resp = self.request(‘GET’, ‘/api/v1/status’, ignore_ConnectionError=ignore_ConnectionError)
[2025-01-03 15:18:22.894] [ERROR] File “/home/opesys/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 381, in request
[2025-01-03 15:18:22.894] [ERROR] return self._request(method, url, data, headers, params, ignore_ConnectionError=ignore_ConnectionError, *args, **kwargs)
[2025-01-03 15:18:22.894] [ERROR] File “/home/opesys/.obd/plugins/oceanbase-ce/4.2.2.0/connect.py”, line 335, in _request
[2025-01-03 15:18:22.894] [ERROR] if parsed_resp.code != 200:
[2025-01-03 15:18:22.894] [ERROR] AttributeError: ‘NoneType’ object has no attribute ‘code’
[2025-01-03 15:18:22.894] [ERROR]
[2025-01-03 15:18:22.895] [DEBUG] - sub bootstrap ref count to 0
[2025-01-03 15:18:22.895] [DEBUG] - export bootstrap
[2025-01-03 15:18:22.895] [DEBUG] - plugin oceanbase-ce-py_script_bootstrap-4.2.2.0 result: False
[2025-01-03 15:18:22.921] [INFO] [ERROR] response parser error: Expecting value: line 1 column 1 (char 0)
[2025-01-03 15:18:22.921] [INFO] [ERROR] oceanbase-ce-py_script_bootstrap-4.2.2.0 RuntimeError: ‘NoneType’ object has no attribute ‘code’
[2025-01-03 15:18:22.921] [INFO]
[2025-01-03 15:18:22.921] [ERROR] Cluster init failed
[2025-01-03 15:18:22.926] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes .
[2025-01-03 15:18:22.926] [INFO] Trace ID: b4273d0c-c9a2-11ef-a1ba-bc24114b410f
[2025-01-03 15:18:22.926] [INFO] If you want to view detailed obd logs, please run: obd display-trace b4273d0c-c9a2-11ef-a1ba-bc24114b410f
[2025-01-03 15:18:22.927] [DEBUG] - unlock /home/opesys/.obd/lock/global
[2025-01-03 15:18:22.927] [DEBUG] - unlock /home/opesys/.obd/lock/deploy_testapp100
[2025-01-03 15:18:22.927] [DEBUG] - unlock /home/opesys/.obd/lock/mirror_and_repo

[opesys@localhost ~]$

#25

使用obd cluster start testapp10 失败后，
执行obd cluster stop testapp100 和obd cluster start testapp100
observer 就可以启动成功，但是obagent还是启动失败

[********@localhost ~]$ obd cluster stop testapp100
Get local repositories ok
Search plugins ok
Open ssh connection ok
Stop observer ok
Stop obshell ok
Stop obagent ok
testapp100 stopped
Trace ID: c1a6288e-c9a3-11ef-9383-bc24114b410f
If you want to view detailed obd logs, please run: obd display-trace c1a6288e-c9a3-11ef-9383-bc24114b410f
[opesys@localhost ~]$ obd cluster start testapp100
Get local repositories ok
Search plugins ok
Load cluster param plugin ok
Open ssh connection ok
Check before start observer ok
Check before start obagent ok
cluster scenario: htap
Start observer ok
observer program health check ok
obshell program health check ok
Connect to observer 100.99.88.107:2881 ok
Start obagent ok
obagent program health check ok
Connect to Obagent x
[ERROR] OBD-1006: Failed to connect to obagent

Wait for observer init ok
±------------------------------------------------+
| oceanbase-ce |
±--------------±--------±-----±------±-------+
| ip | version | port | zone | status |
±--------------±--------±-----±------±-------+
| 100.99.88.107 | 4.3.3.0 | 2881 | zone1 | ACTIVE |
±--------------±--------±-----±------±-------+
obclient -h100.99.88.107 -P2881 -uroot -p’APP#112!user’ -Doceanbase -A

cluster unique id: c9a27c5b-40f7-5785-8de3-8067907d1195-1942b07217e-00030304

See https://www.oceanbase.com/product/ob-deployer/error-codes .
Trace ID: ca783e84-c9a3-11ef-afd6-bc24114b410f
If you want to view detailed obd logs, please run: obd display-trace ca783e84-c9a3-11ef-afd6-bc24114b410f
[opesys@localhost ~]$

#26

继续按照提示查看obagent启动失败的log

[2025-01-03 15:24:59.900] [DEBUG] – opesys@100.99.88.107 execute: cd /observer/obagent;/observer/obagent/bin/ob_agentctl config -u agent.log.path=log/monagent.log,agent.http.basic.auth.username=admin,agent.http.basic.auth.password=0E2Dim5jM,ocp.agent.manager.http.port=8089,mgragent.log.maxsize.mb=30,ocp.agent.monitor.http.port=8088,monagent.ob.monitor.password=w2Uea8ZMVK,monagent.ob.sql.port=2881,monagent.ob.rpc.port=2882,monagent.ob.cluster.name=testapp,monagent.ob.cluster.id=1,monagent.ob.zone.name=zone1,monagent.log.level=info,monagent.pipeline.ob.status=active,obagent.home.path=/observer/obagent,monagent.host.ip=100.99.88.107,ob.log.path=/observer/oceanbase/store,ob.data.path=/observer/oceanbase/store,ob.install.path=/observer/oceanbase,observer.log.path=/observer/oceanbase/log && touch /observer/obagent/.configured
[2025-01-03 15:25:00.016] [DEBUG] – exited code 0
[2025-01-03 15:25:00.017] [DEBUG] – opesys@100.99.88.107 execute: cd /observer/obagent;/observer/obagent/bin/ob_agentctl start
[2025-01-03 15:25:01.126] [DEBUG] – exited code 0
[2025-01-03 15:25:01.229] [INFO] obagent program health check
[2025-01-03 15:25:02.231] [DEBUG] – 100.99.88.107 program health check
[2025-01-03 15:25:02.231] [DEBUG] – opesys@100.99.88.107 execute: cat /observer/obagent/run/ob_agentd.pid
[2025-01-03 15:25:02.251] [DEBUG] – exited code 0
[2025-01-03 15:25:02.252] [DEBUG] – opesys@100.99.88.107 execute: cat /observer/obagent/run/ob_mgragent.pid
[2025-01-03 15:25:02.313] [DEBUG] – exited code 0
[2025-01-03 15:25:02.313] [DEBUG] – opesys@100.99.88.107 execute: bash -c ‘cat /proc/net/{tcp*,udp*}’ | awk -F’ ’ ‘{print $2,$10}’ | grep ‘00000000:1F99’ | awk -F’ ’ ‘{print $2}’ | uniq
[2025-01-03 15:25:02.383] [DEBUG] – exited code 0
[2025-01-03 15:25:02.383] [DEBUG] – 1612666
[2025-01-03 15:25:02.383] [DEBUG]
[2025-01-03 15:25:02.384] [DEBUG] – opesys@100.99.88.107 execute: ls -l /proc/314742/fd/ |grep -E ‘socket:[(1612666)]’
[2025-01-03 15:25:02.446] [DEBUG] – exited code 0
[2025-01-03 15:25:02.446] [DEBUG] – 100.99.88.107 obagent[pid: 314734] started
[2025-01-03 15:25:02.447] [DEBUG] – start to sync target config
[2025-01-03 15:25:02.534] [DEBUG] - sub start ref count to 0
[2025-01-03 15:25:02.535] [DEBUG] - export start
[2025-01-03 15:25:02.535] [DEBUG] - plugin obagent-py_script_start-4.2.2 result: True
[2025-01-03 15:25:02.535] [DEBUG] - Call obagent-py_script_connect-1.3.0 for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2
[2025-01-03 15:25:02.535] [DEBUG] - import connect
[2025-01-03 15:25:02.537] [DEBUG] - add connect ref count to 1
[2025-01-03 15:25:02.538] [INFO] Connect to Obagent
[2025-01-03 15:25:02.538] [DEBUG] – connect obagent (100.99.88.107:8089 by user admin)
[2025-01-03 15:25:02.538] [DEBUG] – send http request method: GET, url: http://100.99.88.107:8089/api/v1/agent/status, data: None
[2025-01-03 15:25:19.724] [DEBUG] – request obagent failed: b’ \n \n \n \n \n \n \n\n\n \n \n \n \n \n body {\n height: 100%;\n font-family: Helvetica, Arial, sans-serif;\n color: #6a6a6a;\n margin: 0;\n display: flex;\n align-items: center;\n justify-content: center;\n }\n input[type=date], input[type=email], input[type=number], input[type=password], input[type=search], input[type=tel], input[type=text], input[type=time], input[type=url], select, textarea {\n color: #262626;\n vertical-align: baseline;\n margin: .2em;\n border-style: solid;\n border-width: 1px;\n border-color: #a9a9a9;\n background-color: #fff;\n box-sizing: border-box;\n padding: 2px .5em;\n appearance: none;\n border-radius: 0;\n }\n input:focus {\n border-color: #646464;\n box-shadow: 0 0 1px 0 #a2a2a2;\n outline: 0;\n }\n button {\n padding: .5em 1em;\n border: 1px solid;\n border-radius: 3px;\n min-width: 6em;\n font-weight: 400;\n font-size: .8em;\n cursor: pointer;\n }\n button.primary {\n color: #fff;\n background-color: rgb(47, 113, 178);\n border-color: rgb(34, 103, 173);\n }\n .message-container {\n height: 500px;\n width: 600px;\n padding: 0;\n margin: 10px;\n }\n .logo {\n background: url(https://globalurl.fortinet.net:8010/XX/YY/ZZ/CI/MGPGHGPGPFGHDDPFGGHGFHBGCHEGPFBGAHAH) no-repeat left center;\n height: 267px;\n object-fit: contain;\n }\n table {\n background-color: #fff;\n border-spacing: 0;\n margin: 1em;\n }\n table > tbody > tr > td:first-of-type:not([colspan]) {\n white-space: nowrap;\n color: rgba(0,0,0,.5);\n }\n table > tbody > tr > td:first-of-type {\n vertical-align: top;\n }\n table > tbody > tr > td {\n padding: .3em .3em;\n }\n .field {\n display: table-row;\n }\n .field > :first-child {\n display: table-cell;\n width: 20%;\n }\n .field.single > :first-child {\n display: inline;\n }\n .field > :not(:first-child) {\n width: auto;\n max-width: 100%;\n display: inline-flex;\n align-items: baseline;\n virtical-align: top;\n box-sizing: border-box;\n margin: .3em;\n }\n .field > :not(:first-child) > input {\n width: 230px;\n }\n .form-footer {\n display: inline-flex;\n justify-content: flex-start;\n }\n .form-footer > * {\n margin: 1em;\n }\n .text-scrollable {\n overflow: auto;\n height: 150px;\n border: 1px solid rgb(200, 200, 200);\n padding: 5px;\n font-size: 1em;\n }\n .text-centered {\n text-align: center;\n }\n .text-container {\n margin: 1em 1.5em;\n }\n .flex-container {\n display: flex;\n }\n .flex-container.column {\n flex-direction: column;\n }\n \n 504 Gateway Timeout: remote server did not respond to the proxy\n \n

\n
\n

504 Gateway Timeout: remote server did not respond to the proxy

\n

The webserver reported that an error occurred while trying to access the website. Please return to the previous page.

\n \n \n \n \n \n
URL http://100.99.88.107:8089/api/v1/agent/status
\n
\n\n\r\n’
[2025-01-03 15:25:19.725] [ERROR] OBD-1006: Failed to connect to obagent
[2025-01-03 15:25:19.757] [INFO] [ERROR] OBD-1006: Failed to connect to obagent
[2025-01-03 15:25:19.757] [INFO]
[2025-01-03 15:25:19.757] [DEBUG] - sub connect ref count to 0
[2025-01-03 15:25:19.758] [DEBUG] - export connect
[2025-01-03 15:25:19.758] [DEBUG] - plugin obagent-py_script_connect-1.3.0 result: False
[2025-01-03 15:25:19.758] [DEBUG] - Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.3.3.0-100000142024101215.el8-3eee13839888800065c13ffc5cd7c3e6b12cb55c
[2025-01-03 15:25:19.758] [DEBUG] - import display
[2025-01-03 15:25:19.760] [DEBUG] - add display ref count to 1
[2025-01-03 15:25:19.760] [INFO] Wait for observer init
[2025-01-03 15:25:19.761] [DEBUG] – execute sql: select * from oceanbase.__all_server. args: None
[2025-01-03 15:25:19.764] [INFO] ±------------------------------------------------+
[2025-01-03 15:25:19.764] [INFO] | oceanbase-ce |
[2025-01-03 15:25:19.764] [INFO] ±--------------±--------±-----±------±-------+
[2025-01-03 15:25:19.764] [INFO] | ip | version | port | zone | status |
[2025-01-03 15:25:19.765] [INFO] ±--------------±--------±-----±------±-------+
[2025-01-03 15:25:19.765] [INFO] | 100.99.88.107 | 4.3.3.0 | 2881 | zone1 | ACTIVE |
[2025-01-03 15:25:19.765] [INFO] ±--------------±--------±-----±------±-------+
[2025-01-03 15:25:19.765] [INFO] obclient -h100.99.88.107 -P2881 -uroot -p’’ -Doceanbase -A
[2025-01-03 15:25:19.892] [INFO] ±------------------------------------------------+
[2025-01-03 15:25:19.892] [INFO] | oceanbase-ce |
[2025-01-03 15:25:19.892] [INFO] ±--------------±--------±-----±------±-------+
[2025-01-03 15:25:19.892] [INFO] | ip | version | port | zone | status |
[2025-01-03 15:25:19.892] [INFO] ±--------------±--------±-----±------±-------+
[2025-01-03 15:25:19.892] [INFO] | 100.99.88.107 | 4.3.3.0 | 2881 | zone1 | ACTIVE |
[2025-01-03 15:25:19.892] [INFO] ±--------------±--------±-----±------±-------+
[2025-01-03 15:25:19.892] [INFO] obclient -h100.99.88.107 -P2881 -uroot -p’’ -Doceanbase -A
[2025-01-03 15:25:19.892] [INFO]
[2025-01-03 15:25:19.892] [DEBUG] – execute sql: select unix_timestamp(gmt_create) as gmt_create from oceanbase.__all_virtual_sys_variable limit 1. args: None
[2025-01-03 15:25:19.900] [INFO] cluster unique id: c9a27c5b-40f7-5785-8de3-8067907d1195-1942b07217e-00030304
[2025-01-03 15:25:19.900] [INFO]
[2025-01-03 15:25:19.900] [DEBUG] - sub display ref count to 0
[2025-01-03 15:25:19.900] [DEBUG] - export display
[2025-01-03 15:25:19.900] [DEBUG] - plugin oceanbase-ce-py_script_display-3.1.0 result: True
[2025-01-03 15:25:19.904] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes .
[2025-01-03 15:25:19.905] [INFO] Trace ID: ca783e84-c9a3-11ef-afd6-bc24114b410f
[2025-01-03 15:25:19.905] [INFO] If you want to view detailed obd logs, please run: obd display-trace ca783e84-c9a3-11ef-afd6-bc24114b410f
[2025-01-03 15:25:19.906] [DEBUG] - unlock /home/opesys/.obd/lock/global
[2025-01-03 15:25:19.906] [DEBUG] - unlock /home/opesys/.obd/lock/deploy_testapp100
[2025-01-03 15:25:19.906] [DEBUG] - unlock /home/opesys/.obd/lock/mirror_and_repo

[opesys@localhost ~]$

#27

image
image730×151 9.43 KB

我看你日志显示实际上ob已经启动成功了，你试试单独启动agent
obd cluster start testapp100 -c obagent

#28

试过了，还是obagent起不来

[opesys@localhost ~]$ obd cluster restart testapp100 -c obagent
Get local repositories and plugins ok
Load cluster param plugin ok
Open ssh connection ok
Cluster status check ok
Check before start obagent ok
Stop obagent ok
Check before start obagent ok
Start obagent ok
obagent program health check ok
Connect to Obagent x
[ERROR] OBD-1006: Failed to connect to obagent

See https://www.oceanbase.com/product/ob-deployer/error-codes .
Trace ID: c68cc020-c9a7-11ef-8340-bc24114b410f
If you want to view detailed obd logs, please run: obd display-trace c68cc020-c9a7-11ef-8340-bc24114b410f
[opesys@localhost ~]$

#29

log错误还是一样的
[2025-01-03 15:53:16.617] [INFO] Connect to Obagent
[2025-01-03 15:53:16.618] [DEBUG] ---- connect obagent (100.99.88.107:8089 by user admin)
[2025-01-03 15:53:16.618] [DEBUG] ---- send http request method: GET, url: http://100.99.88.107:8089/api/v1/agent/status, data: None
[2025-01-03 15:53:32.860] [DEBUG] ---- request obagent failed: b’ \n \n \n \n \n \n \n\n\n \n \n \n \n \n body {\n height: 100%;\n font-family: Helvetica, Arial, sans-serif;\n color: #6a6a6a;\n margin: 0;\n display: flex;\n align-items: center;\n justify-content: center;\n }\n input[type=date], input[type=email], input[type=number], input[type=password], input[type=search], input[type=tel], input[type=text], input[type=time], input[type=url], select, textarea {\n color: #262626;\n vertical-align: baseline;\n margin: .2em;\n border-style: solid;\n border-width: 1px;\n border-color: #a9a9a9;\n background-color: #fff;\n box-sizing: border-box;\n padding: 2px .5em;\n appearance: none;\n border-radius: 0;\n }\n input:focus {\n border-color: #646464;\n box-shadow: 0 0 1px 0 #a2a2a2;\n outline: 0;\n }\n button {\n padding: .5em 1em;\n border: 1px solid;\n border-radius: 3px;\n min-width: 6em;\n font-weight: 400;\n font-size: .8em;\n cursor: pointer;\n }\n button.primary {\n color: #fff;\n background-color: rgb(47, 113, 178);\n border-color: rgb(34, 103, 173);\n }\n .message-container {\n height: 500px;\n width: 600px;\n padding: 0;\n margin: 10px;\n }\n .logo {\n background: url(https://globalurl.fortinet.net:8010/XX/YY/ZZ/CI/MGPGHGPGPFGHDDPFGGHGFHBGCHEGPFBGAHAH) no-repeat left center;\n height: 267px;\n object-fit: contain;\n }\n table {\n background-color: #fff;\n border-spacing: 0;\n margin: 1em;\n }\n table > tbody > tr > td:first-of-type:not([colspan]) {\n white-space: nowrap;\n color: rgba(0,0,0,.5);\n }\n table > tbody > tr > td:first-of-type {\n vertical-align: top;\n }\n table > tbody > tr > td {\n padding: .3em .3em;\n }\n .field {\n display: table-row;\n }\n .field > :first-child {\n display: table-cell;\n width: 20%;\n }\n .field.single > :first-child {\n display: inline;\n }\n .field > :not(:first-child) {\n width: auto;\n max-width: 100%;\n display: inline-flex;\n align-items: baseline;\n virtical-align: top;\n box-sizing: border-box;\n margin: .3em;\n }\n .field > :not(:first-child) > input {\n width: 230px;\n }\n .form-footer {\n display: inline-flex;\n justify-content: flex-start;\n }\n .form-footer > * {\n margin: 1em;\n }\n .text-scrollable {\n overflow: auto;\n height: 150px;\n border: 1px solid rgb(200, 200, 200);\n padding: 5px;\n font-size: 1em;\n }\n .text-centered {\n text-align: center;\n }\n .text-container {\n margin: 1em 1.5em;\n }\n .flex-container {\n display: flex;\n }\n .flex-container.column {\n flex-direction: column;\n }\n \n 504 Gateway Timeout: remote server did not respond to the proxy\n \n

\n
\n

504 Gateway Timeout: remote server did not respond to the proxy

\n

The webserver reported that an error occurred while trying to access the website. Please return to the previous page.

\n \n \n \n \n \n
URL http://100.99.88.107:8089/api/v1/agent/status
\n
\n\n\r\n’
[2025-01-03 15:53:32.861] [ERROR] OBD-1006: Failed to connect to obagent
[2025-01-03 15:53:32.923] [INFO] [ERROR] OBD-1006: Failed to connect to obagent
[2025-01-03 15:53:32.924] [INFO]
[2025-01-03 15:53:32.924] [DEBUG] — sub connect ref count to 0
[2025-01-03 15:53:32.924] [DEBUG] — export connect
[2025-01-03 15:53:32.924] [DEBUG] — plugin obagent-py_script_connect-1.3.0 result: False
[2025-01-03 15:53:32.924] [DEBUG] - sub restart ref count to 0
[2025-01-03 15:53:32.924] [DEBUG] - export restart
[2025-01-03 15:53:32.924] [DEBUG] - plugin obagent-py_script_restart-1.3.0 result: None
[2025-01-03 15:53:32.929] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes .
[2025-01-03 15:53:32.929] [INFO] Trace ID: c68cc020-c9a7-11ef-8340-bc24114b410f
[2025-01-03 15:53:32.929] [INFO] If you want to view detailed obd logs, please run: obd display-trace c68cc020-c9a7-11ef-8340-bc24114b410f
[2025-01-03 15:53:32.930] [DEBUG] - unlock /home/opesys/.obd/lock/global
[2025-01-03 15:53:32.930] [DEBUG] - unlock /home/opesys/.obd/lock/deploy_testapp100
[2025-01-03 15:53:32.930] [DEBUG] - unlock /home/opesys/.obd/lock/mirror_and_repo

[opesys@localhost ~]$

#30

ps -ef|grep agent看看agent起来了么
访问agent获取不到答复，有点怀疑是yaml文件未填写admin用户的密码导致。
你试试yaml中把password加上
image

#31

加上password还是一样的
obagent起不来是因为send http request method: GET, url: http://100.99.88.107:8089/api/v1/agent/status, data: None这里的报 504 Gateway Timeout: remote server did not respond to the proxy

#32

100这个网段我们是内网

#33

找到原因了，是我们加了代理，把代理去掉就可以了。非常感谢您的帮助！