添加节点报错

添加节点报错
oceanbasev4.0
系统centos7.9 x64
bin/observer -i ens192 -c 1 -p 2881 -P 2882 -z ‘zone4’ -n ‘obtest’ -d ‘/data/data’ -r ‘10.105.1.139:2882:2881’ -l WARN -o ‘memory_limit=8GB,datafile_disk_percentage=95’

2023-03-21 15:33:31.786811] ERROR [SHARE] get_block_file_size (ob_local_device.cpp:1359) [17397][][T0][Y0-0000000000000000-0-0] [lt=76] data file size is too large, (ret=-4184, block_file_size_=203455341568, total_space=203426099200, free_space=13659
9068672, reserved_size=10737418240, old_block_file_size=0, block_file_size=203455341568) BACKTRACE:0xb61bbbb 0xb60d4f6 0x3be9fb1 0x3be9c9f 0x3be9aa0 0x3be98e2 0xa8f4425 0xa8e526c 0xa8e6349 0xa8e5e46 0x8bd97a8 0x5be6d34 0x3be6f34 0x7f25154a93d5 0x3be5c
9e
[2023-03-21 15:33:31.787594] WARN [SHARE] open_block_file (ob_local_device.cpp:1394) [17397][][T0][Y0-0000000000000000-0-0] [lt=777] Fail to get block file size(ret=-4184, block_size=2097152, file_size=203455341568, adjust_file_size=203455341568, dis
k_percentage=0)
[2023-03-21 15:33:31.787635] WARN [SHARE] start (ob_local_device.cpp:246) [17397][][T0][Y0-0000000000000000-0-0] [lt=41] Fail to open block file, (ret=-4184)
[2023-03-21 15:33:31.787666] WARN [STORAGE.BLKMGR] start (ob_block_manager.cpp:213) [17397][][T0][Y0-0000000000000000-0-0] [lt=21] start io device fail(ret=-4184)
[2023-03-21 15:33:31.787697] ERROR [SERVER] start (ob_server.cpp:593) [17397][][T0][Y0-0000000000000000-0-0] [lt=21] start block manager fail(ret=-4184, ret=“OB_SERVER_OUTOF_DISK_SPACE”) BACKTRACE:0xb61bbbb 0xb60d4f6 0x3c12f81 0x3c12c84 0x3c12a99 0x3b
f0efb 0x5be889b 0x5be7366 0x3be6f34 0x7f25154a93d5 0x3be5c9e
[2023-03-21 15:33:31.787974] ERROR [SERVER] start (ob_server.cpp:793) [17397][][T0][Y0-0000000000000000-0-0] [lt=265] failure occurs, try to set stop and wait(ret=-4184, ret=“OB_SERVER_OUTOF_DISK_SPACE”) BACKTRACE:0xb61bbbb 0xb60d4f6 0x3c12f81 0x3c12c
84 0x3c12a99 0x3bf0efb 0x5beba69 0x5be783f 0x3be6f34 0x7f25154a93d5 0x3be5c9e
[2023-03-21 15:34:01.617040] WARN [SHARE] process (ob_event_history_table_operator.cpp:161) [17447][EvtHisUpdTask][T0][Y0-0000000000000000-0-0] [lt=42] process_task failed(sql=INSERT INTO all_server_event_history (gmt_create, module, event) VALUES
(usec_to_time(1679384011788210), ‘observer’, ‘stop’), is_delete=false, ret=-4721)
[2023-03-21 15:34:01.618127] ERROR [SERVER] main (main.cpp:534) [17397][][T0][Y0-0000000000000000-0-0] [lt=28] observer start fail(ret=-4184) BACKTRACE:0xb61bbbb 0xb60d4f6 0x3bebb75 0x3beb889 0x3beb6a8 0x3be5eec 0x3be8039 0x3be717c 0x7f25154a93d5 0x3b
e5c9e
[2023-03-21 15:34:03.798014] ERROR [COMMON] reset (ob_fifo_allocator.cpp:200) [17397][][T0][Y0-0000000000000000-0-0] [lt=28] current_using
is still used now(re
f_count=2, current_using
=0x7f2505224030) BACKTRACE:0xb61bbbb 0xb60d4f6 0x3c12f81 0x3c12c84 0x3c12a99 0x3bf0efb 0x3c05dcd 0x3965191 0x7f25154c0b69 0x7f25154c0bb
7 0x7f25154a93dc 0x3be5c9e
[2023-03-21 15:34:03.798191] WARN foreach_refactored (ob_hashtable.h:1307) [17397][][T0][Y0-0000000000000000-0-0] [lt=157] hashtable not init
[2023-03-21 15:34:03.798222] WARN foreach_refactored (ob_hashtable.h:1307) [17397][][T0][Y0-0000000000000000-0-0] [lt=29] hashtable not init
[2023-03-21 15:34:03.810696] WARN [SERVER] destroy (ob_server.cpp:545) [17397][][T0][Y0-0000000000000000-0-0] [lt=24] [OBSERVER_NOTICE] can not destroy observe
r(has_destroy=true, has_stopped=true)
[2023-03-21 15:34:03.810782] WARN [CLOG] destroy (ob_server_log_block_mgr.cpp:116) [17397][][T0][Y0-0000000000000000-0-0] [lt=85] ObServerLogBlockMgr destroy(
this={dir::"", dir_fd:14, meta_fd:15, log_pool_meta:{curr_total_size:0, next_total_size:0, status:0}, min_block_id:0, max_block_id:0, is_inited:false})
[2023-03-21 15:34:03.877935] WARN [COMMON] destroy (ob_thread_cond.cpp:57) [17397][][T0][Y0-0000000000000000-0-0] [lt=44] Fail to destroy pthread cond, (ret=16
)
[2023-03-21 15:34:03.878035] WARN [COMMON] destroy (ob_thread_cond.cpp:65) [17397][][T0][Y0-0000000000000000-0-0] [lt=103] Fail to destroy pthread mutex, (ret=
16)
[2023-03-21 15:34:03.974942] WARN [COMMON] unlock (ob_thread_cond.h:60) [17487][][T0][Y0-0000000000000000-0-0] [lt=0] The thread cond has not been inited, (ret
=-4006, lbt()=0xb61bbbb 0x3c50038 0x3afdb71 0x5c309e9 0xb5fc3ac 0xb5fa7ea 0x7f251585bdd5 0x7f2515584ead)
[2023-03-21 15:34:03.975023] ERROR [COMMON] ~ObLockGuard (ob_lock_guard.h:60) [17487][][T0][Y0-0000000000000000-0-0] [lt=80] Fail to unlock, (ret=-4006) BACKTRA
CE:0xb61bbbb 0xb60d4f6 0x3bebb75 0x3beb889 0x3beb6a8 0x3be5eec 0x3c4ff5d 0x3afdb86 0x5c309e9 0xb5fc3ac 0xb5fa7ea 0x7f251585bdd5 0x7f2515584ead
[2023-03-21 15:34:03.975559] WARN [COMMON] deregister_cache (ob_kv_storecache.cpp:600) [17397][][T0][Y0-0000000000000000-0-0] [lt=38] The ObKVGlobalCache has n
ot been inited, (ret=-4006)
[2023-03-21 15:34:04.020709] ERROR has_unfree_callback (object_set.cpp:34) [17397][][T0][Y0-0000000000000000-0-0] [lt=70] HAS UNFREE PTR!!! context: 0x7f24fc5fa
6b0, label: SchemaSysCache, static_id: 0x117e2098, static_info:{filename: ob_schema_cache.cpp, line: 467, function: init}, dynamic_info:{tid: 17397, cid: 0, cre
ate_time: 1679384010747498} BACKTRACE:0xb61bbbb 0xb60d4f6 0x3be889a 0x3be8577 0x3be8361 0x3bfad18 0x3bfac8d 0x394e45e 0x39057a3 0x3bef76b 0x3905cb8 0x990189b 0x
9858752 0x7f25154c0b69 0x7f25154c0bb7 0x7f25154a93dc 0x3be5c9e
[2023-03-21 15:34:04.021311] WARN [COMMON] deregister_cache (ob_kv_storecache.cpp:600) [17397][][T0][Y0-0000000000000000-0-0] [lt=588] The ObKVGlobalCache has
not been inited, (ret=-4006)
[2023-03-21 15:34:04.021365] WARN [COMMON] deregister_cache (ob_kv_storecache.cpp:600) [17397][][T0][Y0-0000000000000000-0-0] [lt=35] The ObKVGlobalCache has n
ot been inited, (ret=-4006)


看下是不是磁盘空间不足了,可以把datafile_disk_percentage=95这个设置小点

不是这个问题,我之前设置是80,后面改成95 。都会报这样的错误

改成80也不行吧,磁盘总共200G,改成80也需要200*0.8=160G,目前看是只有130G的free

有60G是redo 文件,已经有redo过了。我有把空间清理,还是不行

现在observer log一直在生成日志。不知道什么,现在observer启动了,但是添加这台机器data有120G,redo 有60G 。我的数据只有几个G 我从mysql导入的。这个什么问题。这个官方文档,写也很查,为什么不能用obd 这个来管理集群。没有tidb怎么方便。

1 个赞

白屏ocp,黑屏obd,都可以管理啊

官方没有讲这块

官方文档有说啊。

https://www.oceanbase.com/docs/community-observer-cn-0000000001493530
https://www.oceanbase.com/docs/community-observer-cn-10000000000900887

https://www.oceanbase.com/docs/community-observer-cn-10000000000900534