【 使用环境 】生产环境 or 测试环境
【 OB 组件 】
【 使用版本 】4.2.5.1 社区版
【问题描述】observer 进程cpu使用率一直在波动,没有操作数据库的情况下,cpu使用1-3个核,这属于正常吗?是什么后台操作导致的cpu高,有没有优化措施减少cpu的使用率
1、如果安装了ocp,可以在ocp sql诊断那看看找跑什么sql。
2、也可以直接查询oceanbase.GV$OB_SQL_AUDIT看看;
3、看observer.log日志
就部署了一个3节点的cluster和一个ocp-expresss ,没有任何程序连接,OceanBase内部的操作会不会占用比较多的cpu呢
再问一下 oceanbase.GV$OB_SQL_AUDIT 这个视图记录的sql审计日志 只要数据库不重启,就一直就累加记录吗?
好的,感谢
再咨询一下 正常情况下OceanBase 集群没有连接,cpu使用大概是多少
高到什么程度呢?
observer进程 经常 130%,有时候 240%
这种肯定不正常,我盲猜可能是时钟源的问题,你拿回来obdiag的巡检报告我看下
±------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| critical-tasks-report |
±---------------------------±-------------------------------------------------------------------------------------------------------------------------------------------------+
| task | task_report |
±---------------------------±-------------------------------------------------------------------------------------------------------------------------------------------------+
| cluster.data_path_settings | [critical] [remote_10.0.6.17] ip:10.0.6.17 ,data_dir and log_dir_disk are on the same disk. |
| | [critical] [local] ip:10.0.6.16 ,data_dir and log_dir_disk are on the same disk. |
| | [critical] [remote_10.0.6.12] ip:10.0.6.12 ,data_dir and log_dir_disk are on the same disk. |
| cluster.task_opt_stat | [critical] [cluster:obcluster] The collection of statistical information related to tenants has issues… Please check the tenant_ids: 1001,1002 |
| system.core_pattern | [critical] [remote_10.0.6.12] core_path: . free_space: 5051352 need > 10485760KB (10GB) |
| | [critical] [local] core_path: . free_space: 2343916 need > 10485760KB (10GB) |
| | [critical] [remote_10.0.6.17] core_path: . free_space: 5352624 need > 10485760KB (10GB) |
| network.TCP-retransmission | [critical] [remote_10.0.6.17] tsar is not installed. we can not check tcp retransmission. |
| | [critical] [local] tsar is not installed. we can not check tcp retransmission. |
| | [critical] [remote_10.0.6.12] tsar is not installed. we can not check tcp retransmission. |
±---------------------------±-------------------------------------------------------------------------------------------------------------------------------------------------+
±-----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| warning-tasks-report |
±--------------------------------------------------±-------------------------------------------------------------------------------------------------------------+
| task | task_report |
±--------------------------------------------------±-------------------------------------------------------------------------------------------------------------+
| bugs.bug_385 | [warning] Unadapted by version. SKIP |
| cluster.part_trans_action_max | [warning] Unadapted by version. SKIP |
| cluster.optimizer_better_inlist_costing_parmmeter | [warning] Unadapted by version. SKIP |
| cluster.table_history_too_many | [warning] Unadapted by version. SKIP |
| cluster.ob_enable_plan_cache_bad_version | [warning] Unadapted by version. SKIP |
| cluster.sys_log_level | [warning] [cluster:obcluster] sys_log_level: WARN. on 4.x, the recommended value for sys_log_level is WDIAG |
| system.parameter_ip_local_port_range | [warning] [remote_10.0.6.17] ip_local_port_range_min : 32768. recommended: 3500 |
| | [warning] [remote_10.0.6.12] ip_local_port_range_max : 60999. recommended: 65535 |
| | [warning] [remote_10.0.6.12] ip_local_port_range_min : 32768. recommended: 3500 |
| | [warning] [local] ip_local_port_range_min : 32768. recommended: 3500 |
| | [warning] [local] ip_local_port_range_max : 60999. recommended: 65535 |
| | [warning] [remote_10.0.6.17] ip_local_port_range_max : 60999. recommended: 65535 |
| system.parameter | [warning] [local] fs.pipe-user-pages-soft : 16384. recommended: 0. |
| | [warning] [remote_10.0.6.12] fs.pipe-user-pages-soft : 16384. recommended: 0. |
| | [warning] [remote_10.0.6.17] fs.pipe-user-pages-soft : 16384. recommended: 0. |
| system.instruction_set_avx2 | [warning] Unadapted by version. SKIP |
| err_code.find_err_4012 | [warning] [cluster:obcluster] number of sql_error_4012 is 160 |
±--------------------------------------------------±-------------------------------------------------------------------------------------------------------------+
在阿里云上创建了3个云服务器,没有配置时钟源
查一下 看看三个节点的时间 尽量配置一下时钟源 提供一下 三个节点的observer.log的日志 分析看看
配置了阿里云的时钟源,3台服务器直接没有时间差
观察了一下 cpu使用率高的到时候,observer的日志截取了一点
[2024-12-26 10:17:45.852628] INFO [MDS.EVENT]try_decline_rec_scn (mds_table_base.cpp:250) [18096][T1004_ReplaySrv][T1004][Y0-0000000000000000-0-0] [lt=0] DECLINE_REC_SCN(key={tenant_id:1004, ls_id:{id:1}, tablet_id:{id:60243}}, event={alloc:null, timestamp:“2024-12-26 10:17:45.842850”, ptr:null, event:“DECLINE_REC_SCN”, info_str:"{val:4611686018427387903, v:0} → {val:1735063321497492021, v:0}", unit_id:255, key_str:"", writer_type:0, writer_id:0, seq_no:0, redo_scn:{val:18446744073709551615, v:3}, end_scn:{val:18446744073709551615, v:3}, trans_version:{val:18446744073709551615, v:3}, node_type:0, state:5})
[2024-12-26 10:17:45.852660] INFO [MDS.EVENT]on_redo_ (mds_node.ipp:178) [18096][T1004_ReplaySrv][T1004][Y0-0000000000000000-0-0] [lt=17] ON_REDO(key={tenant_id:1004, ls_id:{id:1}, tablet_id:{id:60243}}, event={alloc:null, timestamp:“2024-12-26 10:17:45.842883”, ptr:0x2ad49e4d9690, event:“ON_REDO”, info_str:"{compaction_type:“MAJOR_COMPACTION”, medium_merge_reason:“TENANT_MAJOR”, medium_snapshot:1735063200228473000, last_medium_snapshot:1, tenant_id:1004, cluster_id:1735008163, medium_compat_version:4, data_version:17180001537, is_schema_changed:0, storage_schema:{this:0x2ad49e4d9a90, storage_schema_version:2, version:0, is_use_bloomfilter:0, column_info_simplified:0, compat_mode:0, table_type:12, index_type:0, index_status:1, row_store_type:1, schema_version:1735012275820048, column_cnt:3, store_column_cnt:3, tablet_size:134217728, pctfree:10, block_size:16384, progressive_merge_round:1, master_key_id:18446744073709551615, compressor_type:1, encryption:"", encrypt_key:"", rowkey_cnt:1, rowkey_array:[{column_idx:16, meta_type:{type:“BIGINT UNSIGNED”, collation:“binary”, coercibility:“NUMERIC”}, order:0}], column_array:[{meta_type:{type:“BIGINT UNSIGNED”, collation:“binary”, coercibility:“NUMERIC”}, is_column_stored_in_sstable:1, is_rowkey_column:1, is_generated_column:0, orig_default_value:{“NULL”:“NULL”}}, {met", unit_id:3, key_str:"", writer_type:3, writer_id:10000, seq_no:0, redo_scn:{val:1735063321497492021, v:0}, end_scn:{val:4611686018427387903, v:0}, trans_version:{val:4611686018427387903, v:0}, node_type:1, state:0})
[2024-12-26 10:17:45.852680] INFO [MDS.EVENT]construct_insert_record_user_mds_node_ (mds_row.ipp:218) [18096][T1004_ReplaySrv][T1004][Y0-0000000000000000-0-0] [lt=10] REPLAY_NODE(key={tenant_id:1004, ls_id:{id:1}, tablet_id:{id:60243}}, event={alloc:null, timestamp:“2024-12-26 10:17:45.842904”, ptr:0x2ad49e4d9690, event:“REPLAY_NODE”, info_str:"{compaction_type:“MAJOR_COMPACTION”, medium_merge_reason:“TENANT_MAJOR”, medium_snapshot:1735063200228473000, last_medium_snapshot:1, tenant_id:1004, cluster_id:1735008163, medium_compat_version:4, data_version:17180001537, is_schema_changed:0, storage_schema:{this:0x2ad49e4d9a90, storage_schema_version:2, version:0, is_use_bloomfilter:0, column_info_simplified:0, compat_mode:0, table_type:12, index_type:0, index_status:1, row_store_type:1, schema_version:1735012275820048, column_cnt:3, store_column_cnt:3, tablet_size:134217728, pctfree:10, block_size:16384, progressive_merge_round:1, master_key_id:18446744073709551615, compressor_type:1, encryption:"", encrypt_key:"", rowkey_cnt:1, rowkey_array:[{column_idx:16, meta_type:{type:“BIGINT UNSIGNED”, collation:“binary”, coercibility:“NUMERIC”}, order:0}], column_array:[{meta_type:{type:“BIGINT UNSIGNED”, collation:“binary”, coercibility:“NUMERIC”}, is_column_stored_in_sstable:1, is_rowkey_column:1, is_generated_column:0, orig_default_value:{“NULL”:“NULL”}}, {met", unit_id:3, key_str:"", writer_type:3, writer_id:10000, seq_no:0, redo_scn:{val:1735063321497492021, v:0}, end_scn:{val:4611686018427387903, v:0}, trans_version:{val:4611686018427387903, v:0}, node_type:1, state:0})
[2024-12-26 10:17:45.852755] INFO [MDS.EVENT]before_prepare_ (mds_node.ipp:202) [18096][T1004_ReplaySrv][T1004][Y0-0000000000000000-0-0] [lt=8] BEFORE_PREPARE(key={tenant_id:1004, ls_id:{id:1}, tablet_id:{id:60243}}, event={alloc:null, timestamp:“2024-12-26 10:17:45.842977”, ptr:0x2ad49e4d9690, event:“BEFORE_PREPARE”, info_str:"{compaction_type:“MAJOR_COMPACTION”, medium_merge_reason:“TENANT_MAJOR”, medium_snapshot:1735063200228473000, last_medium_snapshot:1, tenant_id:1004, cluster_id:1735008163, medium_compat_version:4, data_version:17180001537, is_schema_changed:0, storage_schema:{this:0x2ad49e4d9a90, storage_schema_version:2, version:0, is_use_bloomfilter:0, column_info_simplified:0, compat_mode:0, table_type:12, index_type:0, index_status:1, row_store_type:1, schema_version:1735012275820048, column_cnt:3, store_column_cnt:3, tablet_size:134217728, pctfree:10, block_size:16384, progressive_merge_round:1, master_key_id:18446744073709551615, compressor_type:1, encryption:"", encrypt_key:"", rowkey_cnt:1, rowkey_array:[{column_idx:16, meta_type:{type:“BIGINT UNSIGNED”, collation:“binary”, coercibility:“NUMERIC”}, order:0}], column_array:[{meta_type:{type:“BIGINT UNSIGNED”, collation:“binary”, coercibility:“NUMERIC”}, is_column_stored_in_sstable:1, is_rowkey_column:1, is_generated_column:0, orig_default_value:{“NULL”:“NULL”}}, {met", unit_id:3, key_str:"", writer_type:3, writer_id:10000, seq_no:0, redo_scn:{val:1735063321497492021, v:0}, end_scn:{val:4611686018427387903, v:0}, trans_version:{val:0, v:0}, node_type:1, state:1})
[2024-12-26 10:17:45.852775] INFO [MDS.EVENT]on_prepare_ (mds_node.ipp:230) [18096][T1004_ReplaySrv][T1004][Y0-0000000000000000-0-0] [lt=9] ON_PREPARE(key={tenant_id:1004, ls_id:{id:1}, tablet_id:{id:60243}}, event={alloc:null, timestamp:“2024-12-26 10:17:45.842998”, ptr:0x2ad49e4d9690, event:“ON_PREPARE”, info_str:"{compaction_type:“MAJOR_COMPACTION”, medium_merge_reason:“TENANT_MAJOR”, medium_snapshot:1735063200228473000, last_medium_snapshot:1, tenant_id:1004, cluster_id:1735008163, medium_compat_version:4, data_version:17180001537, is_schema_changed:0, storage_schema:{this:0x2ad49e4d9a90, storage_schema_version:2, version:0, is_use_bloomfilter:0, column_info_simplified:0, compat_mode:0, table_type:12, index_type:0, index_status:1, row_store_type:1, schema_version:1735012275820048, column_cnt:3, store_column_cnt:3, tablet_size:134217728, pctfree:10, block_size:16384, progressive_merge_round:1, master_key_id:18446744073709551615, compressor_type:1, encryption:"", encrypt_key:"", rowkey_cnt:1, rowkey_array:[{column_idx:16, meta_type:{type:“BIGINT UNSIGNED”, collation:“binary”, coercibility:“NUMERIC”}, order:0}], column_array:[{meta_type:{type:“BIGINT UNSIGNED”, collation:“binary”, coercibility:“NUMERIC”}, is_column_stored_in_sstable:1, is_rowkey_column:1, is_generated_column:0, orig_default_value:{“NULL”:“NULL”}}, {met", unit_id:3, key_str:"", writer_type:3, writer_id:10000, seq_no:0, redo_scn:{val:1735063321497492021, v:0}, end_scn:{val:4611686018427387903, v:0}, trans_version:{val:1735063321497492021, v:0}, node_type:1, state:2})
[2024-12-26 10:17:45.852793] INFO [MDS.EVENT]on_commit_ (mds_node.ipp:267) [18096][T1004_ReplaySrv][T1004][Y0-0000000000000000-0-0] [lt=8] ON_COMMIT(key={tenant_id:1004, ls_id:{id:1}, tablet_id:{id:60243}}, event={alloc:null, timestamp:“2024-12-26 10:17:45.843016”, ptr:0x2ad49e4d9690, event:“ON_COMMIT”, info_str:"{compaction_type:“MAJOR_COMPACTION”, medium_merge_reason:“TENANT_MAJOR”, medium_snapshot:1735063200228473000, last_medium_snapshot:1, tenant_id:1004, cluster_id:1735008163, medium_compat_version:4, data_version:17180001537, is_schema_changed:0, storage_schema:{this:0x2ad49e4d9a90, storage_schema_version:2, version:0, is_use_bloomfilter:0, column_info_simplified:0, compat_mode:0, table_type:12, index_type:0, index_status:1, row_store_type:1, schema_version:1735012275820048, column_cnt:3, store_column_cnt:3, tablet_size:134217728, pctfree:10, block_size:16384, progressive_merge_round
cpu 高的时候还有如下如下
[2024-12-26 10:35:43.983597] INFO [CLOG] scan_dir (ob_log_io_adapter.cpp:582) [17545][T1003_PalfGC][T1003][Y0-0000000000000000-0-0] [lt=4] scan_dir success(dir_name="/root/observer/store/clog/tenant_1003/tmp_dir")
[2024-12-26 10:35:43.983614] INFO [PALF] scan_dir (log_io_utils.cpp:287) [17545][T1003_PalfGC][T1003][Y0-0000000000000000-0-0] [lt=16] mkdir success(ret=0, dir_name="/root/observer/store/clog/tenant_1003/tmp_dir")
[2024-12-26 10:35:43.985165] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:179) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=7] refresh resource plan success(tenant_id=1004, plan_name=, directives=[])
[2024-12-26 10:35:43.985374] INFO [SHARE] convert_sys_errno (ob_local_device.cpp:1766) [17301][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=7] convert sys errno(ret=-9100, errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:43.985394] WDIAG [SHARE] stat (ob_local_device.cpp:627) [17301][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-9100] Fail to stat file, (ret=-9100, pathname="/root/observer/store/clog/tenant_1002/tmp_dir", errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:43.986705] INFO [COMMON] try_inc_thread_count (ob_dynamic_thread_pool.cpp:478) [16610][TSWorker0][T0][Y0-0000000000000000-0-0] [lt=28] try inc thread count(*this={name:TSWorker, this:0x2ad41fdd7780, min_thread_cnt:1, max_thread_cnt:1, running_thread_cnt:1, threads_idle_time:1111959641}, cur_thread_count=1, cnt=1, new_thread_count=1)
[2024-12-26 10:35:43.988565] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:189) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=24] refresh resource user mapping rule(tenant_id=1004, plan=, user_rules=[])
[2024-12-26 10:35:43.988970] INFO [STORAGE.TRANS] check_all_readonly_tx_clean_up (ob_ls_tx_service.cpp:370) [18008][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=5] wait_all_readonly_tx_cleaned_up cleaned up success(ls_id={id:1})
[2024-12-26 10:35:43.988990] INFO [STORAGE.TRANS] check_all_readonly_tx_clean_up (ob_ls_tx_service.cpp:370) [18008][T1004_TxLoopWor][T1004][Y0-0000000000000000-0-0] [lt=17] wait_all_readonly_tx_cleaned_up cleaned up success(ls_id={id:1001})
[2024-12-26 10:35:43.989970] INFO [COMMON] try_inc_thread_count (ob_dynamic_thread_pool.cpp:478) [16610][TSWorker0][T0][Y0-0000000000000000-0-0] [lt=20] try inc thread count(*this={name:TSWorker, this:0x2ad41fdd7780, min_thread_cnt:1, max_thread_cnt:1, running_thread_cnt:1, threads_idle_time:1111962872}, cur_thread_count=1, cnt=1, new_thread_count=1)
[2024-12-26 10:35:43.991524] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:227) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=22] refresh resource mapping rule(tenant_id=1004, plan=, rules=[])
[2024-12-26 10:35:43.991545] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:149) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=20] refresh resource mapping rule success(tenant_id=1004, plan=)
[2024-12-26 10:35:43.992880] INFO [COMMON] try_inc_thread_count (ob_dynamic_thread_pool.cpp:478) [16610][TSWorker0][T0][Y0-0000000000000000-0-0] [lt=20] try inc thread count(*this={name:TSWorker, this:0x2ad41fdd7780, min_thread_cnt:1, max_thread_cnt:1, running_thread_cnt:1, threads_idle_time:1111965746}, cur_thread_count=1, cnt=1, new_thread_count=1)
[2024-12-26 10:35:43.993892] INFO [SHARE] convert_sys_errno (ob_local_device.cpp:1766) [17837][T1004_PalfGC][T1004][Y0-0000000000000000-0-0] [lt=6] convert sys errno(ret=-9100, errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:43.993911] WDIAG [SHARE] stat (ob_local_device.cpp:627) [17837][T1004_PalfGC][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-9100] Fail to stat file, (ret=-9100, pathname="/root/observer/store/clog/tenant_1004/tmp_dir", errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:43.994409] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:159) [16672][OmtNodeBalancer][T1004][YB420A00060C-00062A22F1842D81-0-0] [lt=5] trace tenant dfc parameters(max_parallel_cnt_=20, max_blocked_buffer_size_=6553600, max_buffer_size_=13107200)
[2024-12-26 10:35:43.994477] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [16672][OmtNodeBalancer][T1004][YB420A00060C-00062A22F1842D81-0-0] [lt=15] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0)
[2024-12-26 10:35:43.994489] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:131) [16672][OmtNodeBalancer][T1004][YB420A00060C-00062A22F1842D81-0-0] [lt=11] tenant dfc status(ret=0, get_tenant_id()=1004, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=20, get_max_blocked_buffer_size()=6553600, get_max_buffer_size()=13107200, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360)
[2024-12-26 10:35:43.994504] INFO [SERVER.OMT] periodically_check_tenant (ob_tenant_node_balancer.cpp:499) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=7] refresh resource manager plan(plan_mgr=background_quota:2147483647, tenant_plan_map:{1->{value:""}, 1001->{value:""}, 1002->{value:""}, 1003->{value:""}, 1004->{value:""}}, rule_mgr=user_rule_map:{} function_rule_map:{} group_id_name_map:{} group_name_id_map:{}, col_rule_mgr={{v:1}->tenant_id:1, version: 0, rule_id_map:{} group_id_map:{} {v:1001}->tenant_id:1001, version: 0, rule_id_map:{} group_id_map:{} {v:1002}->tenant_id:1002, version: 0, rule_id_map:{} group_id_map:{} {v:1003}->tenant_id:1003, version: 0, rule_id_map:{} group_id_map:{} {v:1004}->tenant_id:1004, version: 0, rule_id_map:{} group_id_map:{} })
[2024-12-26 10:35:43.995004] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:109) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=497] refresh tenant units(sys_unit_cnt=3, units=[{tenant_id:1, unit_id:2, has_memstore:true, unit_status:“NORMAL”, config:{unit_config_id:1, name:“sys_unit_config”, resource:{min_cpu:1, max_cpu:1, memory_size:“1GB”, log_disk_size:“2GB”, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1}}, mode:0, create_timestamp:1735011582798389, is_removed:false}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:“NORMAL”, config:{unit_config_id:1001, name:“ocp_unit”, resource:{min_cpu:1, max_cpu:1, memory_size:“0.5GB”, log_disk_size:“1.5GB”, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1}}, mode:0, create_timestamp:1735011692562018, is_removed:false}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:“NORMAL”, config:{unit_config_id:1001, name:“ocp_unit”, resource:{min_cpu:1, max_cpu:1, memory_size:“0.5GB”, log_disk_size:“0.5GB”, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1}}, mode:0, create_timestamp:1735011692562018, is_removed:false}, {tenant_id:1004, unit_id:1005, has_memstore:true, unit_status:“NORMAL”, config:{unit_config_id:1002, name:“tenant_unit”, resource:{min_cpu:2, max_cpu:2, memory_size:“7GB”, log_disk_size:“3.5GB”, min_iops:10000, max_iops:10000, iops_weight:2}}, mode:0, create_timestamp:1735012248055976, is_removed:false}, {tenant_id:1003, unit_id:1005, has_memstore:true, unit_status:“NORMAL”, config:{unit_config_id:1002, name:“tenant_unit”, resource:{min_cpu:1, max_cpu:1, memory_size:“1GB”, log_disk_size:“0.5GB”, min_iops:10000, max_iops:10000, iops_weight:2}}, mode:0, create_timestamp:1735012248055976, is_removed:false}], ret=0, ret=“OB_SUCCESS”)
[2024-12-26 10:35:43.995043] INFO set_nway (ob_tenant_mutil_allocator.cpp:335) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=32] finish set nway(tenant_id_=1, nway=1)
[2024-12-26 10:35:43.995049] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:404) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=5] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:2, has_memstore:true, unit_status:“NORMAL”, config:{unit_config_id:1, name:“sys_unit_config”, resource:{min_cpu:1, max_cpu:1, memory_size:“1GB”, log_disk_size:“2GB”, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1}}, mode:0, create_timestamp:1735011582798389, is_removed:false})
[2024-12-26 10:35:43.995060] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [16672][OmtNodeBalancer][T1][YB420A00060C-00062A22F1842D81-0-0] [lt=9] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=1.638399963378906250e+02, this=0x2ad429de6170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=819, Resource Limit(MB)=819, Throttle Trigger(MB)=491, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=3.948457122979588263e+01)
[2024-12-26 10:35:43.995078] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:413) [16672][OmtNodeBalancer][T1][YB420A00060C-00062A22F1842D81-0-0] [lt=17] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0)
[2024-12-26 10:35:43.995085] INFO set_nway (ob_tenant_mutil_allocator.cpp:335) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=4] finish set nway(tenant_id_=1002, nway=1)
[2024-12-26 10:35:43.995100] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:404) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=14] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=322122540, pre_tma_limit=322122540, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:“NORMAL”, config:{unit_config_id:1001, name:“ocp_unit”, resource:{min_cpu:1, max_cpu:1, memory_size:“0.5GB”, log_disk_size:“1.5GB”, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1}}, mode:0, create_timestamp:1735011692562018, is_removed:false})
[2024-12-26 10:35:43.995125] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [16672][OmtNodeBalancer][T1002][YB420A00060C-00062A22F1842D81-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x2ad453308170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02)
[2024-12-26 10:35:43.995132] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:413) [16672][OmtNodeBalancer][T1002][YB420A00060C-00062A22F1842D81-0-0] [lt=8] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0)
[2024-12-26 10:35:43.995138] INFO set_nway (ob_tenant_mutil_allocator.cpp:335) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=3] finish set nway(tenant_id_=1001, nway=1)
[2024-12-26 10:35:43.995141] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:404) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=3] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=322122540, pre_tma_limit=322122540, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:“NORMAL”, config:{unit_config_id:1001, name:“ocp_unit”, resource:{min_cpu:1, max_cpu:1, memory_size:“0.5GB”, log_disk_size:“0.5GB”, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1}}, mode:0, create_timestamp:1735011692562018, is_removed:false})
[2024-12-26 10:35:43.995153] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [16672][OmtNodeBalancer][T1001][YB420A00060C-00062A22F1842D81-0-0] [lt=12] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999908447265625e+01, this=0x2ad43f708170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=204, Resource Limit(MB)=204, Throttle Trigger(MB)=122, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=9.749933838971044679e+03)
[2024-12-26 10:35:43.995161] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:413) [16672][OmtNodeBalancer][T1001][YB420A00060C-00062A22F1842D81-0-0] [lt=7] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0)
[2024-12-26 10:35:43.995166] INFO set_nway (ob_tenant_mutil_allocator.cpp:335) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=3] finish set nway(tenant_id_=1004, nway=2)
[2024-12-26 10:35:43.995175] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:404) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=9] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1004, nway=2, new_tma_limit=4509715620, pre_tma_limit=4509715620, cur_memstore_limit_percent=40, tenant_config={tenant_id:1004, unit_id:1005, has_memstore:true, unit_status:“NORMAL”, config:{unit_config_id:1002, name:“tenant_unit”, resource:{min_cpu:2, max_cpu:2, memory_size:“7GB”, log_disk_size:“3.5GB”, min_iops:10000, max_iops:10000, iops_weight:2}}, mode:0, create_timestamp:1735012248055976, is_removed:false})
[2024-12-26 10:35:43.995183] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [16672][OmtNodeBalancer][T1004][YB420A00060C-00062A22F1842D81-0-0] [lt=8] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=5.734399948120117188e+02, this=0x2ad4805ca170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2867, Resource Limit(MB)=2867, Throttle Trigger(MB)=1720, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=2.654160334594075632e-01)
[2024-12-26 10:35:43.995191] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:413) [16672][OmtNodeBalancer][T1004][YB420A00060C-00062A22F1842D81-0-0] [lt=7] succ to set_memstore_threshold of memstore allocator(tenant_id=1004, ret=0)
[2024-12-26 10:35:43.995197] INFO set_nway (ob_tenant_mutil_allocator.cpp:335) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=4] finish set nway(tenant_id_=1003, nway=1)
[2024-12-26 10:35:43.995204] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:404) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=7] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1003, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1003, unit_id:1005, has_memstore:true, unit_status:“NORMAL”, config:{unit_config_id:1002, name:“tenant_unit”, resource:{min_cpu:1, max_cpu:1, memory_size:“1GB”, log_disk_size:“0.5GB”, min_iops:10000, max_iops:10000, iops_weight:2}}, mode:0, create_timestamp:1735012248055976, is_removed:false})
[2024-12-26 10:35:43.995217] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [16672][OmtNodeBalancer][T1003][YB420A00060C-00062A22F1842D81-0-0] [lt=12] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x2ad472f08170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02)
[2024-12-26 10:35:43.995226] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:413) [16672][OmtNodeBalancer][T1003][YB420A00060C-00062A22F1842D81-0-0] [lt=8] succ to set_memstore_threshold of memstore allocator(tenant_id=1003, ret=0)
[2024-12-26 10:35:43.996349] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:309) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=5] cal_all_part_disk_default_percentage succ(data_dir="/root/observer/store/sstable", clog_dir="/root/observer/store/clog", shared_mode=true, data_disk_total_size=60470063104, data_disk_default_percentage=60, clog_disk_total_size=60470063104, clog_disk_default_percentage=30)
[2024-12-26 10:35:43.996371] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:345) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=21] decide disk size finished(suggested_disk_size=17179869184, suggested_disk_percentage=0, default_disk_percentage=30, total_space=60470063104, disk_size=17179869184)
[2024-12-26 10:35:43.996377] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=6] get_log_disk_info_in_config(suggested_data_disk_size=17179869184, suggested_clog_disk_size=17179869184, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=17179869184, log_disk_percentage=0, total_log_disk_size=60470063104)
[2024-12-26 10:35:43.996384] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:765) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=6] try_resize success(ret=0, log_disk_size=17179869184, total_log_disk_size=60470063104, this={dir::"/root/observer/store/clog/log_pool", log_pool_meta:{curr_total_size:17179869184, next_total_size:17179869184, status:0}, min_block_id:107, max_block_id:285, min_log_disk_size_for_all_tenants_:10737418240, is_inited:true})
[2024-12-26 10:35:43.996398] INFO [CLOG] init (ob_log_io_adapter.cpp:54) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=13] init ObLogIOInfo success(this={io_mode:“LOCAL”, cluster_id:1735008163, log_store_addr:“0.0.0.0:0”})
[2024-12-26 10:35:43.996405] INFO [CLOG] try_switch_log_io_mode (ob_log_io_adapter.cpp:210) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=6] no need switch_log_io_mode(io_info={io_mode:“LOCAL”, cluster_id:1735008163, log_store_addr:“0.0.0.0:0”}, using_mode_=1)
[2024-12-26 10:35:43.996416] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:137) [16672][OmtNodeBalancer][T0][YB420A00060C-00062A22F1842D81-0-0] [lt=11] refresh tenant config(tenants=[1, 1001, 1002, 1003, 1004], ret=0)
[2024-12-26 10:35:43.998058] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [17389][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret=“OB_NEED_WAIT”)
[2024-12-26 10:35:44.000400] INFO [STORAGE.TRANS] check_all_readonly_tx_clean_up (ob_ls_tx_service.cpp:370) [17639][T1003_TxLoopWor][T1003][Y0-0000000000000000-0-0] [lt=19] wait_all_readonly_tx_cleaned_up cleaned up success(ls_id={id:1})
[2024-12-26 10:35:44.005918] WDIAG load_file_to_string (utility.h:674) [16443][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=4][errcode=0] read /sys/class/net/eth0/speed failed, errno 22
[2024-12-26 10:35:44.005940] WDIAG get_ethernet_speed (utility.cpp:584) [16443][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4000] load file /sys/class/net/eth0/speed failed, ret -4000
[2024-12-26 10:35:44.005945] WDIAG [SERVER] get_network_speed_from_sysfs (ob_server.cpp:2876) [16443][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4000] cannot get Ethernet speed, use default(tmp_ret=0, devname=“eth0”)
[2024-12-26 10:35:44.005951] WDIAG [SERVER] runTimerTask (ob_server.cpp:3410) [16443][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4000] ObRefreshNetworkSpeedTask reload bandwidth throttle limit failed(ret=-4000, ret=“OB_ERROR”)
[2024-12-26 10:35:44.007572] INFO [COMMON] try_inc_thread_count (ob_dynamic_thread_pool.cpp:478) [17831][T1004_LogIOCb0][T1004][Y0-0000000000000000-0-0] [lt=36] try inc thread count(*this={name:LogIOCb, this:0x2ad4735fc410, min_thread_cnt:1, max_thread_cnt:1, running_thread_cnt:1, threads_idle_time:1093994520}, cur_thread_count=1, cnt=1, new_thread_count=1)
[2024-12-26 10:35:44.008778] INFO [SHARE] convert_sys_errno (ob_local_device.cpp:1766) [16779][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=8] convert sys errno(ret=-9100, errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:44.008802] WDIAG [SHARE] stat (ob_local_device.cpp:627) [16779][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=23][errcode=-9100] Fail to stat file, (ret=-9100, pathname="/root/observer/store/clog/tenant_1/tmp_dir", errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:44.011465] INFO [SHARE] convert_sys_errno (ob_local_device.cpp:1766) [17002][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=7] convert sys errno(ret=-9100, errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:44.011488] WDIAG [SHARE] stat (ob_local_device.cpp:627) [17002][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=22][errcode=-9100] Fail to stat file, (ret=-9100, pathname="/root/observer/store/clog/tenant_1001/tmp_dir", errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:44.014647] INFO [CLOG] scan_dir (ob_log_io_adapter.cpp:582) [17545][T1003_PalfGC][T1003][Y0-0000000000000000-0-0] [lt=5] scan_dir success(dir_name="/root/observer/store/clog/tenant_1003/tmp_dir")
[2024-12-26 10:35:44.014668] INFO [PALF] scan_dir (log_io_utils.cpp:287) [17545][T1003_PalfGC][T1003][Y0-0000000000000000-0-0] [lt=20] mkdir success(ret=0, dir_name="/root/observer/store/clog/tenant_1003/tmp_dir")
[2024-12-26 10:35:44.014862] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_ls_info.cpp:54) [16857][T1_L5_G0][T1][YB420A000611-00062A22F99420D6-0-0] [lt=20][errcode=-4008] execute fail(ret=-4008)
[2024-12-26 10:35:44.014931] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:541) [16828][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=8] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1735180543727737000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=287190, in_cluster_service=true, cluster_version={val:1735180543626621000, v:0}, min_cluster_version={val:1735180543626621000, v:0}, max_cluster_version={val:1735180543626621000, v:0}, get_cluster_version_err=0, cluster_version_delta=388306, cluster_service_master=“10.0.6.12:2882”, cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=10569, succ_cluster_heartbeat_count=7, cluster_heartbeat_interval=50000, local_cluster_version={val:1735180152975353000, v:0}, local_cluster_delta=391039574, force_self_check=false, weak_read_refresh_interval=100000)
[2024-12-26 10:35:44.015208] INFO [STORAGE.TRANS] check_all_readonly_tx_clean_up (ob_ls_tx_service.cpp:370) [17408][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=3] wait_all_readonly_tx_cleaned_up cleaned up success(ls_id={id:1})
[2024-12-26 10:35:44.015225] INFO [STORAGE.TRANS] check_all_readonly_tx_clean_up (ob_ls_tx_service.cpp:370) [17408][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] wait_all_readonly_tx_cleaned_up cleaned up success(ls_id={id:1001})
[2024-12-26 10:35:44.015282] INFO [STORAGE.TRANS] check_all_readonly_tx_clean_up (ob_ls_tx_service.cpp:370) [17408][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] wait_all_readonly_tx_cleaned_up cleaned up success(ls_id={id:1002})
[2024-12-26 10:35:44.015290] INFO [STORAGE.TRANS] check_all_readonly_tx_clean_up (ob_ls_tx_service.cpp:370) [17408][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=6] wait_all_readonly_tx_cleaned_up cleaned up success(ls_id={id:1003})
[2024-12-26 10:35:44.015458] INFO [SHARE] convert_sys_errno (ob_local_device.cpp:1766) [17301][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=6] convert sys errno(ret=-9100, errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:44.015478] WDIAG [SHARE] stat (ob_local_device.cpp:627) [17301][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-9100] Fail to stat file, (ret=-9100, pathname="/root/observer/store/clog/tenant_1002/tmp_dir", errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:44.018451] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:239) [17433][T1003_Occam][T1003][YB420A00060C-00062A22F6E43083-0-0] [lt=17] for each ls(succ_num=1, ret=0, ret=“OB_SUCCESS”)
[2024-12-26 10:35:44.019762] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:261) [16837][T1_ArcSender][T1][YB420A00060C-00062A22F2342D14-0-0] [lt=23][errcode=-4018] try free send task failed(ret=-4018)
[2024-12-26 10:35:44.023992] INFO [SHARE] convert_sys_errno (ob_local_device.cpp:1766) [17837][T1004_PalfGC][T1004][Y0-0000000000000000-0-0] [lt=6] convert sys errno(ret=-9100, errno=2, errmsg=“No such file or directory”)
[2024-12-26 10:35:44.024012] WDIAG [SHARE] stat (ob_local_device.cpp:627) [17837][T1004_PalfGC][T1004][Y0-0000000000000000-0-0] [lt=19][errcode=-9100] Fail to stat file, (ret=-9100, pathname="/root/observer/store/clog/tenant_1004/tmp_dir", errno=2, errmsg=“No such file or directory”)
你把这三节点的observer.log的日志 整个压缩发一下
[errcode=-9100] Fail to stat file,
- OceanBase 错误码:9100
- 错误原因:存储层找不到对应的目录或者文件,可能是配置的存储目录有问题。
在官网下载的安装包 oceanbase-all-in-one-4.2.5_bp1_20241219.el7.x86_64.tar.gz
使用obd 安装的3节点的 cluster,yaml 文件使用包里面自带的default-components.yaml
3个服务器的配置是4核16G 60G的磁盘
内容如下:
Only need to configure when remote login is required
user:
username: xx
password: xxxx
key_file: your ssh-key file path if need
port: your ssh port, default 22
timeout: ssh connection timeout (second), default 30
oceanbase-ce:
servers:
- name: server1
# Please don’t use hostname, only IP can be supported
ip: 10.0.6.16
- name: server2
ip: 10.0.6.12
- name: server3
ip: 10.0.6.17
global:
# Starting from observer version 4.2, the network selection for the observer is based on the ‘local_ip’ parameter, and the ‘devname’ parameter is no longer mandatory.
# If the ‘local_ip’ parameter is set, the observer will first use this parameter for the configuration, regardless of the ‘devname’ parameter.
# If only the ‘devname’ parameter is set, the observer will use the ‘devname’ parameter for the configuration.
# If neither the ‘devname’ nor the ‘local_ip’ parameters are set, the ‘local_ip’ parameter will be automatically assigned the IP address configured above.
# devname: eth0
# if current hardware’s memory capacity is smaller than 50G, please use the setting of “mini-single-example.yaml” and do a small adjustment.
memory_limit: 12G # The maximum running memory for an observer
# The reserved system memory. system_memory is reserved for general tenants. The default value is 30G.
system_memory: 1G
datafile_size: 20G # Size of the data file.
log_disk_size: 20G # The size of disk space used by the clog files.
enable_syslog_wf: false # Print system logs whose levels are higher than WARNING to a separate log file. The default value is true.
max_syslog_file_count: 4 # The maximum number of reserved log files before enabling auto recycling. The default value is 0.
# Cluster name for OceanBase Database. The default value is obcluster. When you deploy OceanBase Database and obproxy, this value must be the same as the cluster_name for obproxy.
# appname: obcluster
# root_password: # root user password
# proxyro_password: # proxyro user pasword, consistent with obproxy’s observer_sys_password, can be empty
# ocp_meta_db: ocp_express # The database name of ocp express meta
# ocp_meta_username: meta # The username of ocp express meta
# ocp_meta_password: ‘’ # The password of ocp express meta
# ocp_agent_monitor_password: ‘’ # The password for obagent monitor user
ocp_meta_tenant: # The config for ocp express meta tenant
tenant_name: ocp
max_cpu: 1
memory_size: 1G
log_disk_size: 4096M # The recommend value is (4608 + (expect node num + expect tenant num) * 512) M.
In this example , support multiple ob process in single node, so different process use different ports.
If deploy ob cluster in multiple nodes, the port and path setting can be same.
server1:
mysql_port: 2881 # External port for OceanBase Database. The default value is 2881. DO NOT change this value after the cluster is started.
rpc_port: 2882 # Internal port for OceanBase Database. The default value is 2882. DO NOT change this value after the cluster is started.
obshell_port: 2886 # Operation and maintenance port for Oceanbase Database. The default value is 2886. This parameter is valid only when the version of oceanbase-ce is 4.2.2.0 or later.
# The working directory for OceanBase Database. OceanBase Database is started under this directory. This is a required field.
home_path: /root/observer
# The directory for data storage. The default value is $home_path/store.
# data_dir: /data
# The directory for clog, ilog, and slog. The default value is the same as the data_dir value.
# redo_dir: /redo
zone: zone1
server2:
mysql_port: 2881 # External port for OceanBase Database. The default value is 2881. DO NOT change this value after the cluster is started.
rpc_port: 2882 # Internal port for OceanBase Database. The default value is 2882. DO NOT change this value after the cluster is started.
obshell_port: 2886 # Operation and maintenance port for Oceanbase Database. The default value is 2886. This parameter is valid only when the version of oceanbase-ce is 4.2.2.0 or later.
# The working directory for OceanBase Database. OceanBase Database is started under this directory. This is a required field.
home_path: /root/observer
# The directory for data storage. The default value is $home_path/store.
# data_dir: /data
# The directory for clog, ilog, and slog. The default value is the same as the data_dir value.
# redo_dir: /redo
zone: zone2
server3:
mysql_port: 2881 # External port for OceanBase Database. The default value is 2881. DO NOT change this value after the cluster is started.
rpc_port: 2882 # Internal port for OceanBase Database. The default value is 2882. DO NOT change this value after the cluster is started.
obshell_port: 2886 # Operation and maintenance port for Oceanbase Database. The default value is 2886. This parameter is valid only when the version of oceanbase-ce is 4.2.2.0 or later.
# The working directory for OceanBase Database. OceanBase Database is started under this directory. This is a required field.
home_path: /root/observer
# The directory for data storage. The default value is $home_path/store.
# data_dir: /data
# The directory for clog, ilog, and slog. The default value is the same as the data_dir value.
# redo_dir: /redo
zone: zone3
obproxy-ce:
Set dependent components for the component.
When the associated configurations are not done, OBD will automatically get the these configurations from the dependent components.
depends:
- oceanbase-ce
servers:
- name: server1
# Please don’t use hostname, only IP can be supported
ip: 10.0.6.16
- name: server2
ip: 10.0.6.12
- name: server3
ip: 10.0.6.17
global:
listen_port: 2883 # External port. The default value is 2883.
prometheus_listen_port: 2884 # The Prometheus port. The default value is 2884.
home_path: /root/obproxy
# oceanbase root server list
# format: ip:mysql_port;ip:mysql_port. When a depends exists, OBD gets this value from the oceanbase-ce of the depends.
# rs_list: 192.168.1.2:2881;192.168.1.3:2881;192.168.1.4:2881
enable_cluster_checkout: false
# observer cluster name, consistent with oceanbase-ce’s appname. When a depends exists, OBD gets this value from the oceanbase-ce of the depends.
# cluster_name: obcluster
skip_proxy_sys_private_check: true
enable_strict_kernel_release: false
# obproxy_sys_password: # obproxy sys user password, can be empty. When a depends exists, OBD gets this value from the oceanbase-ce of the depends.
# observer_sys_password: # proxyro user pasword, consistent with oceanbase-ce’s proxyro_password, can be empty. When a depends exists, OBD gets this value from the oceanbase-ce of the depends.
obagent:
depends:
- oceanbase-ce
servers:
- name: server1
# Please don’t use hostname, only IP can be supported
ip: 10.0.6.16
- name: server2
ip: 10.0.6.12
- name: server3
ip: 10.0.6.17
global:
home_path: /root/obagent
ocp-express:
depends:
- oceanbase-ce
- obproxy-ce
- obagent
servers:
- 10.0.6.17
global:
# The working directory for prometheus. prometheus is started under this directory. This is a required field.
home_path: /root/ocp-express
# log_dir: /home/oceanbase/ocp-express/log # The log directory of ocp express server. The default value is {home_path}/log.
memory_size: 1G # The memory size of ocp-express server. The recommend value is 512MB * (expect node num + expect tenant num) * 60MB.
# logging_file_total_size_cap: 10G # The total log file size of ocp-express server
# logging_file_max_history: 1 # The maximum of retention days the log archive log files to keep. The default value is unlimited
obd cluster list --查看集群名
obd clsuter edit-config {集群名} --三个节点都查看一下 保存文件 发一下 上面发的信息太乱了