修改集群syslog_level参数为WARN时，日志中记录的是TRACE级别日志

AntTech_4O9IRR · 2024 年9 月 24 日 17:22

AntTech_4O9IRR · 2024 年9 月 24 日 17:24

辞霜 · 2024 年9 月 24 日 17:43

syslog_level用于设置系统日志打印级别，这边测试并未复现

烫烫烫 · 2025 年4 月 18 日 10:55

遇到了相同的问题。
无论syslog_level设置成什么，observer.log都会打印很多TRACE级别的日志。
请问是正常的吗，如果想关闭的话该怎么关闭呢？
目前使用的版本是oceanbase-ce-4.2.1.10-110000072024112010.el7.x86_64.rpm

[2025-04-18 10:56:25.585426] TRACE [TRACE] after_process (obmp_base.cpp:154) [902015][T1_L0_G10000][T1][YB420B26ECEA-00062E7C5D82C323-0-0] [lt=52] [err query](TRACE=begin_ts=1744944985585414 2025-04-18 02:56:25.585414|[process_begin] u=0 in_queue_time:31, receive_ts:1744944985585382, enqueue_ts:1744944985585384|[start_sql] u=0 addr:{ip:"127.0.0.1", port:60504}|[query_begin] u=1 trace_id:YB420B26ECEA-00062E7C5D82C323-0-0|[before_processor_run] u=3 |[session] u=2 sid:3222198411, tenant_id:1|[session] u=1 sid:3222198411, tenant_id:1|[process_end] u=3 run_ts:1744944985585419|[process_ret] u=0 process_ret:-4009|total_timeu=10)
[2025-04-18 10:56:25.992536] TRACE [TRACE] after_process (obmp_base.cpp:154) [902013][T1_L0_G10000][T1][YB420B26ECEA-00062E7C46EE7E51-0-0] [lt=46] [err query](TRACE=begin_ts=1744944985992526 2025-04-18 02:56:25.992526|[process_begin] u=0 in_queue_time:13, receive_ts:1744944985992512, enqueue_ts:1744944985992512|[start_sql] u=0 addr:{ip:"127.0.0.1", port:60396}|[query_begin] u=0 trace_id:YB420B26ECEA-00062E7C46EE7E51-0-0|[before_processor_run] u=3 |[session] u=1 sid:3222193065, tenant_id:1|[session] u=1 sid:3222193065, tenant_id:1|[process_end] u=2 run_ts:1744944985992529|[process_ret] u=0 process_ret:-4009|total_timeu=7)
[2025-04-18 10:56:26.824687] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [914039][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45] [dump tenant_info_loader](TRACE=begin_ts=1744944986824683 2025-04-18 02:56:26.824683|[ob_tenant_info_loader] u=0 tenant_id:1002, is_sys_ls_leader:false, broadcast_cost_time:1, broadcast_times:0, broadcast_per_sec:0, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:1744944963985330, sql_update_cost_time:1807, sql_update_times:0, tenant_info_cache:{tenant_info:{tenant_id:1002, switchover_epoch:0, sync_scn:{scn_val:1744944985261655155}, replayable_scn:{scn_val:1744944985261655155}, standby_scn:{scn_val:1744944985250670107}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1744944986822881, ora_rowscn:1744944986389567744}, is_inited:true|total_timeu=0)
[2025-04-18 10:56:28.438917] TRACE [TRACE] print_trace_log_if_necessary_ (ob_trans_ctx.cpp:149) [2001889][T1003_ReplaySrv][T1003][Y0-0000000000000000-0-0] [lt=16] [trans sampling] (TRACE=begin_ts=1744944988438846 2025-04-18 02:56:28.438846|[init] u=0 addr:0x7f8d17945850, id:1, trans_id:{txid:80622849}, ref:0, opid:77811140|[replay_redo] u=48 ret:0, used:2, need_replay:true, offset:44794468719, t:{scn_val:1744944988437016475}, ref:2|[replay_commit_info] u=6 ret:0, used:2, offset:44794468719, t:{scn_val:1744944988437016475}, ref:2, opid:77811148|[push_max_commit_version] u=5 trans_version:{scn_val:1744944988437016475}, ref:2, opid:77811151|total_timeu=59)
[2025-04-18 10:56:28.438972] TRACE [TRACE] print_trace_log_if_necessary_ (ob_trans_ctx.cpp:149) [2001889][T1003_ReplaySrv][T1003][Y0-0000000000000000-0-0] [lt=51] [trans sampling] (TRACE=begin_ts=1744944988438846 2025-04-18 02:56:28.438846|[init] u=0 addr:0x7f8d17945850, id:1, trans_id:{txid:80622849}, ref:0, opid:77811140|[replay_redo] u=48 ret:0, used:2, need_replay:true, offset:44794468719, t:{scn_val:1744944988437016475}, ref:2|[replay_commit_info] u=6 ret:0, used:2, offset:44794468719, t:{scn_val:1744944988437016475}, ref:2, opid:77811148|[push_max_commit_version] u=5 trans_version:{scn_val:1744944988437016475}, ref:2, opid:77811151|[exiting] u=64 ref:2, arg1:0, opid:77811151|[replay_commit] u=1 ret:0, used:68, offset:44794468719, t:{scn_val:1744944988437016475}, ref:1, opid:77811151|[destroy] u=1 opid:77811154|total_timeu=125)
[2025-04-18 10:56:28.824784] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [914039][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45] [dump tenant_info_loader](TRACE=begin_ts=1744944988824780 2025-04-18 02:56:28.824780|[ob_tenant_info_loader] u=0 tenant_id:1002, is_sys_ls_leader:false, broadcast_cost_time:0, broadcast_times:0, broadcast_per_sec:0, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:1744944963985330, sql_update_cost_time:1716, sql_update_times:0, tenant_info_cache:{tenant_info:{tenant_id:1002, switchover_epoch:0, sync_scn:{scn_val:1744944987272767575}, replayable_scn:{scn_val:1744944987272767575}, standby_scn:{scn_val:1744944987272767575}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1744944988823069, ora_rowscn:1744944988421810210}, is_inited:true|total_timeu=0)
[2025-04-18 10:56:30.059166] TRACE [TRACE] print_trace_log_if_necessary_ (ob_trans_ctx.cpp:149) [914371][T1001_ReplaySrv][T1001][Y0-0000000000000000-0-0] [lt=27] [trans sampling] (TRACE=begin_ts=1744944990059039 2025-04-18 02:56:30.059039|[init] u=0 addr:0x7f8d4cf83650, id:1, trans_id:{txid:81884929}, ref:0, opid:1606854|[replay_redo] u=93 ret:0, used:2, need_replay:true, offset:45643237580, t:{scn_val:1744944990057437611}, ref:2|[replay_commit_info] u=12 ret:0, used:5, offset:45643237580, t:{scn_val:1744944990057437611}, ref:2, opid:1606862|[push_max_commit_version] u=7 trans_version:{scn_val:1744944990057437611}, ref:2, opid:1606865|total_timeu=112)
[2025-04-18 10:56:30.059221] TRACE [TRACE] print_trace_log_if_necessary_ (ob_trans_ctx.cpp:149) [914371][T1001_ReplaySrv][T1001][Y0-0000000000000000-0-0] [lt=51] [trans sampling] (TRACE=begin_ts=1744944990059039 2025-04-18 02:56:30.059039|[init] u=0 addr:0x7f8d4cf83650, id:1, trans_id:{txid:81884929}, ref:0, opid:1606854|[replay_redo] u=93 ret:0, used:2, need_replay:true, offset:45643237580, t:{scn_val:1744944990057437611}, ref:2|[replay_commit_info] u=12 ret:0, used:5, offset:45643237580, t:{scn_val:1744944990057437611}, ref:2, opid:1606862|[push_max_commit_version] u=7 trans_version:{scn_val:1744944990057437611}, ref:2, opid:1606865|[exiting] u=67 ref:2, arg1:0, opid:1606865|[replay_commit] u=0 ret:0, used:70, offset:45643237580, t:{scn_val:1744944990057437611}, ref:1, opid:1606865|[destroy] u=3 opid:1606868|total_timeu=182)
[2025-04-18 10:56:30.824603] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [914039][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42] [dump tenant_info_loader](TRACE=begin_ts=1744944990824600 2025-04-18 02:56:30.824600|[ob_tenant_info_loader] u=0 tenant_id:1002, is_sys_ls_leader:false, broadcast_cost_time:0, broadcast_times:0, broadcast_per_sec:0, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:1744944963985330, sql_update_cost_time:1354, sql_update_times:0, tenant_info_cache:{tenant_info:{tenant_id:1002, switchover_epoch:0, sync_scn:{scn_val:1744944989283484357}, replayable_scn:{scn_val:1744944989283484357}, standby_scn:{scn_val:1744944989283484357}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1744944990823251, ora_rowscn:1744944990455615862}, is_inited:true|total_timeu=0)
[2025-04-18 10:56:31.824756] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [914039][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45] [dump tenant_info_loader](TRACE=begin_ts=1744944991824753 2025-04-18 02:56:31.824753|[ob_tenant_info_loader] u=0 tenant_id:1002, is_sys_ls_leader:false, broadcast_cost_time:0, broadcast_times:0, broadcast_per_sec:0, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:1744944963985330, sql_update_cost_time:1396, sql_update_times:0, tenant_info_cache:{tenant_info:{tenant_id:1002, switchover_epoch:0, sync_scn:{scn_val:1744944990288857846}, replayable_scn:{scn_val:1744944990288857846}, standby_scn:{scn_val:1744944990288857846}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1744944991823362, ora_rowscn:1744944991470286521}, is_inited:true|total_timeu=0)
[2025-04-18 10:56:32.825120] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [914039][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=44] [dump tenant_info_loader](TRACE=begin_ts=1744944992825116 2025-04-18 02:56:32.825116|[ob_tenant_info_loader] u=0 tenant_id:1002, is_sys_ls_leader:false, broadcast_cost_time:1, broadcast_times:0, broadcast_per_sec:0, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:1744944963985330, sql_update_cost_time:1694, sql_update_times:0, tenant_info_cache:{tenant_info:{tenant_id:1002, switchover_epoch:0, sync_scn:{scn_val:1744944991394834431}, replayable_scn:{scn_val:1744944991394834431}, standby_scn:{scn_val:1744944991394834431}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1744944992823427, ora_rowscn:1744944992484357375}, is_inited:true|total_timeu=0)
[2025-04-18 10:56:33.866877] TRACE [TRACE] print_trace_log_if_necessary_ (ob_trans_ctx.cpp:149) [2004962][T1005_ReplaySrv][T1005][Y0-0000000000000000-0-0] [lt=16] [trans sampling] (TRACE=begin_ts=1744944993866817 2025-04-18 02:56:33.866817|[init] u=0 addr:0x7f8c91372350, id:1, trans_id:{txid:80624641}, ref:0, opid:16669503|[replay_redo] u=37 ret:0, used:1, need_replay:true, offset:44798178603, t:{scn_val:1744944993865330918}, ref:2|[replay_commit_info] u=5 ret:0, used:2, offset:44798178603, t:{scn_val:1744944993865330918}, ref:2, opid:16669511|[push_max_commit_version] u=3 trans_version:{scn_val:1744944993865330918}, ref:2, opid:16669514|total_timeu=45)
[2025-04-18 10:56:33.866922] TRACE [TRACE] print_trace_log_if_necessary_ (ob_trans_ctx.cpp:149) [2004962][T1005_ReplaySrv][T1005][Y0-0000000000000000-0-0] [lt=42] [trans sampling] (TRACE=begin_ts=1744944993866817 2025-04-18 02:56:33.866817|[init] u=0 addr:0x7f8c91372350, id:1, trans_id:{txid:80624641}, ref:0, opid:16669503|[replay_redo] u=37 ret:0, used:1, need_replay:true, offset:44798178603, t:{scn_val:1744944993865330918}, ref:2|[replay_commit_info] u=5 ret:0, used:2, offset:44798178603, t:{scn_val:1744944993865330918}, ref:2, opid:16669511|[push_max_commit_version] u=3 trans_version:{scn_val:1744944993865330918}, ref:2, opid:16669514|[exiting] u=58 ref:2, arg1:0, opid:16669514|[replay_commit] u=0 ret:0, used:60, offset:44798178603, t:{scn_val:1744944993865330918}, ref:1, opid:16669514|[destroy] u=2 opid:16669517|total_timeu=105)
[2025-04-18 10:56:34.539138] TRACE [TRACE] after_process (obmp_base.cpp:154) [902015][T1_L0_G10000][T1][YB420B26ECEA-00062E7C5D82C326-0-0] [lt=33] [err query](TRACE=begin_ts=1744944994539121 2025-04-18 02:56:34.539121|[process_begin] u=0 in_queue_time:27, receive_ts:1744944994539093, enqueue_ts:1744944994539096|[start_sql] u=0 addr:{ip:"127.0.0.1", port:60546}|[query_begin] u=1 trace_id:YB420B26ECEA-00062E7C5D82C326-0-0|[before_processor_run] u=5 |[session] u=2 sid:3222198310, tenant_id:1|[session] u=3 sid:3222198310, tenant_id:1|[process_end] u=2 run_ts:1744944994539128|[process_ret] u=1 process_ret:-4009|total_timeu=14)
[2025-04-18 10:56:34.686389] TRACE [TRACE] after_process (obmp_base.cpp:154) [902012][T1_L0_G10000][T1][YB420B26ECEA-00062E7C45FF2B3D-0-0] [lt=30] [err query](TRACE=begin_ts=1744944994686373 2025-04-18 02:56:34.686373|[process_begin] u=0 in_queue_time:21, receive_ts:1744944994686351, enqueue_ts:1744944994686354|[start_sql] u=0 addr:{ip:"127.0.0.1", port:60472}|[query_begin] u=1 trace_id:YB420B26ECEA-00062E7C45FF2B3D-0-0|[before_processor_run] u=5 |[session] u=2 sid:3222197907, tenant_id:1|[session] u=2 sid:3222197907, tenant_id:1|[process_end] u=3 run_ts:1744944994686379|[process_ret] u=0 process_ret:-4009|total_timeu=13)
[2025-04-18 10:56:34.686974] TRACE [TRACE] after_process (obmp_base.cpp:154) [902013][T1_L0_G10000][T1][YB420B26ECEA-00062E7C46EE7E54-0-0] [lt=37] [err query](TRACE=begin_ts=1744944994686960 2025-04-18 02:56:34.686960|[process_begin] u=0 in_queue_time:34, receive_ts:1744944994686925, enqueue_ts:1744944994686929|[start_sql] u=0 addr:{ip:"127.0.0.1", port:60548}|[query_begin] u=1 trace_id:YB420B26ECEA-00062E7C46EE7E54-0-0|[before_processor_run] u=5 |[session] u=2 sid:3222190968, tenant_id:1|[session] u=1 sid:3222190968, tenant_id:1|[process_end] u=2 run_ts:1744944994686966|[process_ret] u=1 process_ret:-4009|total_timeu=12)
[2025-04-18 10:56:34.824026] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [2004642][T1006_TenantInf][T1006][Y0-0000000000000000-0-0] [lt=41] [dump tenant_info_loader](TRACE=begin_ts=1744944994824022 2025-04-18 02:56:34.824022|[ob_tenant_info_loader] u=0 tenant_id:1006, is_sys_ls_leader:false, broadcast_cost_time:0, broadcast_times:0, broadcast_per_sec:0, rpc_update_times:12, rpc_update_per_sec:0, last_rpc_update_time_us:1744944993030641, sql_update_cost_time:1505, sql_update_times:0, tenant_info_cache:{tenant_info:{tenant_id:1006, switchover_epoch:0, sync_scn:{scn_val:1744944992903237587}, replayable_scn:{scn_val:1744944992903237587}, standby_scn:{scn_val:1744944992903237587}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1744944994822523, ora_rowscn:1744944994031584244}, is_inited:true|total_timeu=0)
[2025-04-18 10:56:34.824609] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [2001542][T1004_TenantInf][T1004][Y0-0000000000000000-0-0] [lt=31] [dump tenant_info_loader](TRACE=begin_ts=1744944994824606 2025-04-18 02:56:34.824606|[ob_tenant_info_loader] u=0 tenant_id:1004, is_sys_ls_leader:false, broadcast_cost_time:0, broadcast_times:0, broadcast_per_sec:0, rpc_update_times:12, rpc_update_per_sec:0, last_rpc_update_time_us:1744944993034324, sql_update_cost_time:1534, sql_update_times:0, tenant_info_cache:{tenant_info:{tenant_id:1004, switchover_epoch:0, sync_scn:{scn_val:1744944992903020124}, replayable_scn:{scn_val:1744944992903020124}, standby_scn:{scn_val:1744944992903020124}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1744944994823077, ora_rowscn:1744944994039260237}, is_inited:true|total_timeu=0)
[2025-04-18 10:56:34.824995] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [914039][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=58] [dump tenant_info_loader](TRACE=begin_ts=1744944994824992 2025-04-18 02:56:34.824992|[ob_tenant_info_loader] u=0 tenant_id:1002, is_sys_ls_leader:false, broadcast_cost_time:0, broadcast_times:0, broadcast_per_sec:0, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:1744944963985330, sql_update_cost_time:1377, sql_update_times:0, tenant_info_cache:{tenant_info:{tenant_id:1002, switchover_epoch:0, sync_scn:{scn_val:1744944993392185191}, replayable_scn:{scn_val:1744944993392185191}, standby_scn:{scn_val:1744944993392185191}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1744944994823621, ora_rowscn:1744944994513572305}, is_inited:true|total_timeu=0)

辞霜 · 2025 年4 月 18 日 11:20

https://www.oceanbase.com/docs/common-oceanbase-database-cn-1000000002012813
参考这里设置不生效么

烫烫烫 · 2025 年4 月 23 日 10:40

设置了之后除了TRACE的似乎都生效。只是这个TRACE级别的日志，无论我设置成神什么级别，都会出来。上面这段日志就是我在设置了WARN级别后打印出来的。
就是我设置成了INFO，那么打印出来的日志是INFO+TRACE。
如果我设置成了WARN，打印出来的就是WARN+TRACE。只不过目前没有警告日志，所以看着全是TRACE。

辞霜 · 2025 年4 月 23 日 11:00

稍等这边测试一下

辞霜 · 2025 年4 月 23 日 11:28

这边测试修改日志等级后并未出现TRACE级别的日志。WARN级别也进行测试了。你的ob版本是多少

烫烫烫 · 2025 年4 月 23 日 11:49

目前我使用的版本是oceanbase-ce-4.2.1.10-110000072024112010.el7.x86_64.rpm，用这个包安装的。

辞霜 · 2025 年4 月 23 日 14:07

换新版本425的试试

烫烫烫 · 2025 年6 月 10 日 16:21

这个TRACE的问题主要发生在OCP的metadb上。我们尝试对OCP的metadb进行升级，但是显示无法升级。

烫烫烫 · 2025 年6 月 10 日 16:23

我们尝试重新安装OCP，但是在安装界面也显示，不允许我们更换metadb的版本，只能使用4.2.1.8

辞霜 · 2025 年6 月 10 日 16:26

用obd 升级 metadb

烫烫烫 · 2025 年6 月 10 日 17:04

使用obd升级ocp metadb成功，目前升级到4.2.5.4，将log level设置成warn之后还是有trace日志打印。

[2025-06-10 17:00:55.176994] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [1667494][T1004_TenantInf][T1004][Y0-0000000000000000-0-0] [lt=78] [dump tenant_info_loader](TRACE=begin_ts=1749546055176992 2025-06-10 09:00:55.176992|[ob_tenant_info_loader] u=0 tenant_id:1004, is_sys_ls_leader:true, broadcast_cost_time:189, broadcast_times:2, broadcast_per_sec:1, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:-1, sql_update_cost_time:1171, sql_update_times:2, tenant_info_cache:{tenant_info:{tenant_id:1004, switchover_epoch:0, sync_scn:{scn_val:1749546053127479000}, replayable_scn:{scn_val:1749546053127479000}, standby_scn:{scn_val:1749546053027000000}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1749546055175463, ora_rowscn:1749546054201839000}, is_inited:true|total_timeu=0)
[2025-06-10 17:00:56.024935] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [1667047][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=106] [dump tenant_info_loader](TRACE=begin_ts=1749546056024933 2025-06-10 09:00:56.024933|[ob_tenant_info_loader] u=0 tenant_id:1002, is_sys_ls_leader:true, broadcast_cost_time:170, broadcast_times:2, broadcast_per_sec:2, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:-1, sql_update_cost_time:1231, sql_update_times:2, tenant_info_cache:{tenant_info:{tenant_id:1002, switchover_epoch:0, sync_scn:{scn_val:1749546054031768000}, replayable_scn:{scn_val:1749546054031768000}, standby_scn:{scn_val:1749546053931675000}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1749546056023077, ora_rowscn:1749546055122603000}, is_inited:true|total_timeu=0)
[2025-06-10 17:00:57.177511] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [1667494][T1004_TenantInf][T1004][Y0-0000000000000000-0-0] [lt=79] [dump tenant_info_loader](TRACE=begin_ts=1749546057177509 2025-06-10 09:00:57.177509|[ob_tenant_info_loader] u=0 tenant_id:1004, is_sys_ls_leader:true, broadcast_cost_time:226, broadcast_times:2, broadcast_per_sec:1, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:-1, sql_update_cost_time:1539, sql_update_times:2, tenant_info_cache:{tenant_info:{tenant_id:1004, switchover_epoch:0, sync_scn:{scn_val:1749546055136405000}, replayable_scn:{scn_val:1749546055136405000}, standby_scn:{scn_val:1749546055136405000}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1749546057174952, ora_rowscn:1749546056271113000}, is_inited:true|total_timeu=0)
[2025-06-10 17:00:58.025127] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [1667047][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=82] [dump tenant_info_loader](TRACE=begin_ts=1749546058025125 2025-06-10 09:00:58.025125|[ob_tenant_info_loader] u=0 tenant_id:1002, is_sys_ls_leader:true, broadcast_cost_time:176, broadcast_times:2, broadcast_per_sec:1, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:-1, sql_update_cost_time:1244, sql_update_times:2, tenant_info_cache:{tenant_info:{tenant_id:1002, switchover_epoch:0, sync_scn:{scn_val:1749546056038921000}, replayable_scn:{scn_val:1749546056038921000}, standby_scn:{scn_val:1749546056038921000}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1749546058023645, ora_rowscn:1749546057195025000}, is_inited:true|total_timeu=0)

辞霜 · 2025 年6 月 10 日 17:12

停掉ocp服务还是meta集群也停掉了？
不太了解你描述的问题

烫烫烫 · 2025 年6 月 10 日 17:22

不好意思，我刚才的描述有误。
OCP安装在192.168.0.115上，业务集群安装在192.168.0.119上。
OCP集群目前已经升级到4.2.5.4，系统日志级别修改为WARN，但是还是有TRACE日志输出。

tail -f /home/admin/oceanbase/log/observer.log

[2025-06-10 17:00:55.176994] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [1667494][T1004_TenantInf][T1004][Y0-0000000000000000-0-0] [lt=78] [dump tenant_info_loader](TRACE=begin_ts=1749546055176992 2025-06-10 09:00:55.176992|[ob_tenant_info_loader] u=0 tenant_id:1004, is_sys_ls_leader:true, broadcast_cost_time:189, broadcast_times:2, broadcast_per_sec:1, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:-1, sql_update_cost_time:1171, sql_update_times:2, tenant_info_cache:{tenant_info:{tenant_id:1004, switchover_epoch:0, sync_scn:{scn_val:1749546053127479000}, replayable_scn:{scn_val:1749546053127479000}, standby_scn:{scn_val:1749546053027000000}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1749546055175463, ora_rowscn:1749546054201839000}, is_inited:true|total_timeu=0)
[2025-06-10 17:00:56.024935] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [1667047][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=106] [dump tenant_info_loader](TRACE=begin_ts=1749546056024933 2025-06-10 09:00:56.024933|[ob_tenant_info_loader] u=0 tenant_id:1002, is_sys_ls_leader:true, broadcast_cost_time:170, broadcast_times:2, broadcast_per_sec:2, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:-1, sql_update_cost_time:1231, sql_update_times:2, tenant_info_cache:{tenant_info:{tenant_id:1002, switchover_epoch:0, sync_scn:{scn_val:1749546054031768000}, replayable_scn:{scn_val:1749546054031768000}, standby_scn:{scn_val:1749546053931675000}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1749546056023077, ora_rowscn:1749546055122603000}, is_inited:true|total_timeu=0)
[2025-06-10 17:00:57.177511] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [1667494][T1004_TenantInf][T1004][Y0-0000000000000000-0-0] [lt=79] [dump tenant_info_loader](TRACE=begin_ts=1749546057177509 2025-06-10 09:00:57.177509|[ob_tenant_info_loader] u=0 tenant_id:1004, is_sys_ls_leader:true, broadcast_cost_time:226, broadcast_times:2, broadcast_per_sec:1, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:-1, sql_update_cost_time:1539, sql_update_times:2, tenant_info_cache:{tenant_info:{tenant_id:1004, switchover_epoch:0, sync_scn:{scn_val:1749546055136405000}, replayable_scn:{scn_val:1749546055136405000}, standby_scn:{scn_val:1749546055136405000}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1749546057174952, ora_rowscn:1749546056271113000}, is_inited:true|total_timeu=0)
[2025-06-10 17:00:58.025127] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [1667047][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=82] [dump tenant_info_loader](TRACE=begin_ts=1749546058025125 2025-06-10 09:00:58.025125|[ob_tenant_info_loader] u=0 tenant_id:1002, is_sys_ls_leader:true, broadcast_cost_time:176, broadcast_times:2, broadcast_per_sec:1, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:-1, sql_update_cost_time:1244, sql_update_times:2, tenant_info_cache:{tenant_info:{tenant_id:1002, switchover_epoch:0, sync_scn:{scn_val:1749546056038921000}, replayable_scn:{scn_val:1749546056038921000}, standby_scn:{scn_val:1749546056038921000}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1749546058023645, ora_rowscn:1749546057195025000}, is_inited:true|total_timeu=0)

业务集群目前使用的版本是4.3.5.2，没有这个问题。但是OCP的metadb好像无法升级到这个版本，求大佬支持一下，怎么搞定这个问题。

辞霜 · 2025 年6 月 10 日 17:40

黑屏化登录看一下参数
SHOW PARAMETERS LIKE ‘%syslog_level%’;

烫烫烫 · 2025 年6 月 10 日 17:58

辞霜 · 2025 年6 月 10 日 18:16

修改为wdiag看看

烫烫烫 · 2025 年6 月 10 日 18:23

修改后日志刷的比较快，但还是有TRACE的日志

[2025-06-10 18:22:05.792895] INFO  [LIB] stat (utility.h:1221) [1696632][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=112] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=11688, this=0x7f2561df64b0, extra_info="")
[2025-06-10 18:22:05.792908] INFO  [LIB] stat (utility.h:1221) [1696632][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=41] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=0, this=0x7f2561df66e0, extra_info="")
[2025-06-10 18:22:05.792918] INFO  [LIB] stat (utility.h:1221) [1696632][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=31] [APPLY STAT CB EXECUTE TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=-597, this=0x7f2561df6910, extra_info="")
[2025-06-10 18:22:05.792927] INFO  [LIB] stat (utility.h:1221) [1696632][T1003_ApplySrv0][T1003][Y0-0000000000000000-0-0] [lt=29] [APPLY STAT CB TOTAL TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=11109, this=0x7f2561df6b40, extra_info="")
[2025-06-10 18:22:05.793883] TRACE [TRACE] dump_tenant_info_ (ob_tenant_info_loader.cpp:238) [1696709][T1004_TenantInf][T1004][Y0-0000000000000000-0-0] [lt=73] [dump tenant_info_loader](TRACE=begin_ts=1749550925793881 2025-06-10 10:22:05.793881|[ob_tenant_info_loader] u=0 tenant_id:1004, is_sys_ls_leader:true, broadcast_cost_time:299, broadcast_times:1, broadcast_per_sec:1, rpc_update_times:0, rpc_update_per_sec:0, last_rpc_update_time_us:-1, sql_update_cost_time:2244, sql_update_times:1, tenant_info_cache:{tenant_info:{tenant_id:1004, switchover_epoch:0, sync_scn:{scn_val:1749550924360609000}, replayable_scn:{scn_val:1749550924360609000}, standby_scn:{scn_val:1749550924360609000}, recovery_until_scn:{scn_val:4611686018427387903}, tenant_role:{value:1}, switchover_status:{value:1}}, last_sql_update_time:1749550925791333, ora_rowscn:1749550925466594000}, is_inited:true|total_timeu=0)
[2025-06-10 18:22:05.795815] INFO  [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1081) [1696503][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=87] [PALF STAT GROUP LOG INFO](palf_id=1, self="192.168.0.115:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1095, avg_group_log_size=121)
[2025-06-10 18:22:05.795841] INFO  [PALF] submit_log (palf_handle_impl.cpp:458) [1696503][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=74] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"192.168.0.115:2882", has_set_deleted:false}, append size=1095)
[2025-06-10 18:22:05.795853] INFO  [STORAGE.TRANS] check_all_readonly_tx_clean_up (ob_ls_tx_service.cpp:370) [1696503][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] wait_all_readonly_tx_cleaned_up cleaned up success(ls_id={id:1})
[2025-06-10 18:22:05.795886] INFO  [STORAGE.TRANS] check_all_readonly_tx_clean_up (ob_ls_tx_service.cpp:370) [1696503][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] wait_all_readonly_tx_cleaned_up cleaned up success(ls_id={id:1001})
[2025-06-10 18:22:05.796169] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:508) [1696709][T1004_TenantInf][T1004][Y0-0000000000000000-0-0] [lt=167][errcode=-4152] get obj error(ret=-4152)
[2025-06-10 18:22:05.796193] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:574) [1696709][T1004_TenantInf][T1004][Y0-0000000000000000-0-0] [lt=78][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152)
[2025-06-10 18:22:05.799728] INFO  [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1156) [1695728][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-5221994496, global_cache_size=682491904, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[500, 508, 1, 1001, 1002, 1003, 1004])