docker ERROR Another app is currently holding the obd lock

[huangfu]

【 使用环境 】 测试环境
【 OB or 其他组件 】 docker 安装的 OBD
【 使用版本 】
【问题描述】清晰明确描述问题
【复现路径】问题出现前后相关操作
【问题现象及影响】
每次关闭docker停止obd服务,再次启动的时候，obd 每次都启动不了报错如图：
【附件】

[秃蛙]

obd命令不支持多用户执行，可以看下是否有其他obd命令在运行，杀掉后再试试。

[egegredsfew]

我使用 docker启动 的
docker run -p 2881:2881 --name obstandalone -v /home/zjhe/oceanbase/ob:/root/ob -v /home/zjhe/oceanbase/obd:/root/.obd -e MODE=mini -e OB_MEMORY_LIMIT=2G -e OB_SYSTEM_MEMORY=500m -e OB_ROOT_PASSWORD=wODvkWcPxBVTQU7w -d oceanbase/oceanbase-ce:latest
然后停止容器
删除容器，
再次重新创建容器启动，就报错。
遇到两种报错 ：

1、 [DEBUG] – local execute: cd /root/ob; /root/ob/bin/observer -r ‘127.0.0.1:2882:2881’ -p 2881 -P 2882 -z ‘zone1’ -n ‘obcluster’ -c 1 -d ‘/root/ob/store’ -i ‘lo’ -l ‘INFO’ -o __min_full_resource_pool_memory=2147483648,memory_limit=‘3G’,system_memory=‘1G’,datafile_size=‘5G’,log_disk_size=‘5G’,cpu_count=16,enable_syslog_wf=False,enable_syslog_recycle=True,max_syslog_file_count=4
[2023-11-01 02:47:21.058] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] – exited code 0
[2023-11-01 02:47:21.059] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] – root@127.0.0.1 delete env LD_LIBRARY_PATH
[2023-11-01 02:47:21.059] [fa22f74a-7860-11ee-b1a6-0242ac110002] [INFO] observer program health check
[2023-11-01 02:47:24.063] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] – 127.0.0.1 program health check
[2023-11-01 02:47:24.063] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] – local execute: cat /root/ob/run/observer.pid
[2023-11-01 02:47:24.066] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] – exited code 1, error output:
[2023-11-01 02:47:24.066] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] cat: /root/ob/run/observer.pid: No such file or directory
[2023-11-01 02:47:24.066] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG]
[2023-11-01 02:47:24.067] [fa22f74a-7860-11ee-b1a6-0242ac110002] [WARNING] OBD-2002: Failed to start 127.0.0.1 observer
[2023-11-01 02:47:24.067] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] - sub start ref count to 0
[2023-11-01 02:47:24.067] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] - export start
[2023-11-01 02:47:24.067] [fa22f74a-7860-11ee-b1a6-0242ac110002] [ERROR] oceanbase-ce start failed
[2023-11-01 02:47:24.069] [fa22f74a-7860-11ee-b1a6-0242ac110002] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes .
[2023-11-01 02:47:24.069] [fa22f74a-7860-11ee-b1a6-0242ac110002] [INFO] Trace ID: fa22f74a-7860-11ee-b1a6-0242ac110002
[2023-11-01 02:47:24.069] [fa22f74a-7860-11ee-b1a6-0242ac110002] [INFO] If you want to view detailed obd logs, please run: obd display-trace fa22f74a-7860-11ee-b1a6-0242ac110002
[2023-11-01 02:47:24.069] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 1
[2023-11-01 02:47:24.069] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] - share lock /root/.obd/lock/mirror_and_repo release, count 0
[2023-11-01 02:47:24.070] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] - unlock /root/.obd/lock/mirror_and_repo
[2023-11-01 02:47:24.070] [fa22f74a-7860-11ee-b1a6-0242ac110002] [DEBUG] - exclusive lock /root/.obd/lock/deploy_obcluster release, count 0

2、[8b323b9a-785e-11ee-a8bb-6add6a2eabef] [ERROR] _errno.LockError: [Errno 9] Bad file descriptor
[2023-11-01 02:29:55.282] [8b323b9a-785e-11ee-a8bb-6add6a2eabef] [ERROR]
[2023-11-01 02:29:55.282] [8b323b9a-785e-11ee-a8bb-6add6a2eabef] [INFO] Trace ID: 8b323b9a-785e-11ee-a8bb-6add6a2eabef
[2023-11-01 02:29:55.282] [8b323b9a-785e-11ee-a8bb-6add6a2eabef] [INFO] If you want to view detailed obd logs, please run: obd display-trace 8b323b9a-785e-11ee-a8bb-6add6a2eabef
[2023-11-01 02:29:55.282] [8b323b9a-785e-11ee-a8bb-6add6a2eabef] [DEBUG] - unlock /root/.obd/lock/global
[2023-11-01 02:29:56.310] [8bd19de8-785e-11ee-a9a4-6add6a2eabef] [DEBUG] - cmd: []
[2023-11-01 02:29:56.311] [8bd19de8-785e-11ee-a9a4-6add6a2eabef] [DEBUG] - opts: {}
[2023-11-01 02:29:56.311] [8bd19de8-785e-11ee-a9a4-6add6a2eabef] [DEBUG] - mkdir /root/.obd/lock/
…skipping…
[2023-11-01 02:52:48.369] [bda0a000-7861-11ee-9d9c-4e37ab7c9d6c] [ERROR] _errno.LockError: [Errno 9] Bad file descriptor
[2023-11-01 02:52:48.369] [bda0a000-7861-11ee-9d9c-4e37ab7c9d6c] [ERROR]
[2023-11-01 02:52:48.369] [bda0a000-7861-11ee-9d9c-4e37ab7c9d6c] [INFO] Trace ID: bda0a000-7861-11ee-9d9c-4e37ab7c9d6c
[2023-11-01 02:52:48.369] [bda0a000-7861-11ee-9d9c-4e37ab7c9d6c] [INFO] If you want to view detailed obd logs, please run: obd display-trace bda0a000-7861-11ee-9d9c-4e37ab
7c9d6c
[2023-11-01 02:52:48.369] [bda0a000-7861-11ee-9d9c-4e37ab7c9d6c] [DEBUG] - unlock /root/.obd/lock/global
[2023-11-01 02:52:49.335] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [DEBUG] - cmd: [‘obcluster’]
[2023-11-01 02:52:49.335] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [DEBUG] - opts: {‘tenant_name’: ‘test’, ‘max_cpu’: None, ‘min_cpu’: None, ‘max_memory’: None, ‘min_memory’: None, ‘memory_size’: None, ‘max_disk_size’: None, ‘log_disk_size’: None, ‘max_iops’: None, ‘min_iops’: None, ‘iops_weight’: None, ‘max_session_num’: None, ‘unit_num’: None, ‘zone_list’: None, ‘mode’: ‘mysql’, ‘charset’: None, ‘collate’: None, ‘replica_num’: None, ‘logonly_replica_num’: None, ‘tablegroup’: None, ‘primary_zone’: ‘RANDOM’, ‘locality’: None, ‘variables’: “ob_tcp_invited_nodes=’%’”}
[2023-11-01 02:52:49.335] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [DEBUG] - mkdir /root/.obd/lock/
[2023-11-01 02:52:49.336] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [DEBUG] - unknown lock mode
[2023-11-01 02:52:49.337] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [DEBUG] - try to get share lock /root/.obd/lock/global
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] Another app is currently holding the obd lock.
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] Traceback (most recent call last):
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] File “_lock.py”, line 71, in _sh_lock
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] File “tool.py”, line 483, in share_lock_obj
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] OSError: [Errno 9] Bad file descriptor
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR]
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] During handling of the above exception, another exception occurred:
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR]
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] Traceback (most recent call last):
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] File “obd.py”, line 234, in do_command
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] File “core.py”, line 75, in init
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] File “_lock.py”, line 268, in global_sh_lock
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] File “_lock.py”, line 259, in _sh_lock
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] File “_lock.py”, line 254, in _lock
[2023-11-01 02:52:49.338] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] File “_lock.py”, line 176, in lock
[2023-11-01 02:52:49.339] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] File “_lock.py”, line 77, in sh_lock
[2023-11-01 02:52:49.339] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] File “_lock.py”, line 73, in _sh_lock
[2023-11-01 02:52:49.339] [be3474a6-7861-11ee-9e7e-4e37ab7c9d6c] [ERROR] _errno.LockError: [Errno 9] Bad file descriptor