【 使用环境 】 ceanBase 3.2.4.1
【 OB or 其他组件 】
【 使用版本 】
【问题描述】obcp练习
【复现路径】问题出现前后相关操作
【附件及日志】
2024-07-16 18:46:03.501 INFO 10 — [pool-manual-subtask-executor16,847e489e3aa043f1,77d0c718ca13] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, MAX(CASE name WHEN ‘region’ THEN info ELSE ‘’ END ) region, MAX(CASE name WHEN ‘idc’ THEN info ELSE ‘’ END ) idc, MAX(CASE name WHEN ‘status’ THEN info ELSE ‘’ END ) status, MAX(CASE name WHEN ‘merge_status’ THEN info ELSE ‘’ END ) merge_status, MAX(CASE name WHEN ‘broadcast_version’ THEN value ELSE 0 END ) broadcast_version, MAX(CASE name WHEN ‘all_merged_version’ THEN value ELSE 0 END ) all_merged_version, MAX(CASE name WHEN ‘last_merged_version’ THEN value ELSE 0 END ) last_merged_version, MAX(CASE name WHEN ‘merge_start_time’ THEN value ELSE 0 END ) merge_start_time, MAX(CASE name WHEN ‘last_merged_time’ THEN value ELSE 0 END ) last_merged_time, MAX(CASE name WHEN ‘is_merge_timeout’ THEN value ELSE 0 END ) merge_timeout FROM oceanbase.__all_zone WHERE zone <> ‘’ GROUP BY zone
2024-07-16 18:46:03.509 WARN 10 — [pool-manual-subtask-executor16,847e489e3aa043f1,77d0c718ca13] com.oceanbase.ocp.common.pattern.Retry : failed to execute target runnable, errMsg:regionName not found, zoneName=zone1, regionName=zjhz
2024-07-16 18:46:03.514 WARN 10 — [pool-manual-subtask-executor16,847e489e3aa043f1,77d0c718ca13] c.o.o.c.t.engine.runner.RunnerFactory : Execute task failed, subtask=SubtaskInstanceOverview{id=37909, name=Sync cluster info, state=FAILED, operation=RETRY, className=com.oceanbase.ocp.service.task.business.cluster.SyncClusterInfoTask, seriesId=2, startTime=2024-07-16T18:26:42.985+08:00, endTime=null}
java.lang.RuntimeException: java.lang.IllegalArgumentException: regionName not found, zoneName=zone1, regionName=zjhz
在ocp 练习中我执行了alter system modify zone “zone1” set region = “zjhz”;
alter system modify zone “zone2” set region = “zjhz”;
alter system modify zone “zone3” set region = “zjhz”;
alter system modify zone “zone1” set idc = “yh”;
alter system modify zone “zone2” set idc = “yh”;
alter system modify zone “zone3” set idc = “yh”;
使用ocp 重启observe 失败,提示regionName not found,
后来尝试修改region 与 IDC 进行设置 还是报错,observe进程在但是连不上
observe 日志
[2024-07-16 18:56:18.008861] TRACE [TRACE]obmp_base.cpp:152 [112948][0][YB4214909717-00061D5AC8229DD0-0-0] [lt=18] [dc=0] [err query](TRACE=begin_ts=1721127378008793 2024-07-16 10:56:18.008793|[start_sql] u=0 addr:{ip:“127.0.0.1”, port:48732}|[process_begin] u=2 addr:{ip:“127.0.0.1”, port:48732}, in_queue_time:72, receive_ts:1721127378008720, enqueue_ts:1721127378008723, trace_id:YB4214909717-00061D5AC8229DD0-0-0|[process_end] u=18 run_ts:1721127378008806|[process_ret] u=0 process_ret:-4009|total_timeu=20)
[2024-07-16 18:56:19.386709] TRACE [TRACE]obmp_base.cpp:152 [112950][0][YB4214909717-00061D5AC8029E63-0-0] [lt=41] [dc=0] [err query](TRACE=begin_ts=1721127379386622 2024-07-16 10:56:19.386622|[start_sql] u=0 addr:{ip:“127.0.0.1”, port:48868}|[process_begin] u=3 addr:{ip:“127.0.0.1”, port:48868}, in_queue_time:51, receive_ts:1721127379386569, enqueue_ts:1721127379386571, trace_id:YB4214909717-00061D5AC8029E63-0-0|[process_end] u=22 run_ts:1721127379386639|[process_ret] u=1 process_ret:-4009|total_timeu=26)
[2024-07-16 18:56:44.185109] TRACE [TRACE]ob_trans_ctx.cpp:504 [113001][0][Y0-0000000000000000-0-0] [lt=46] [dc=0] [trans sampling] (TRACE=begin_ts=1721127404181789 2024-07-16 10:56:44.181789|[init] u=0 arg1:140637654991440, ctx_type:“participant”, trans_type:0, trans_id:{hash:15931593353680266274, inc:65374, addr:{ip:“20.144.151.23”, port:2882}, t:1721127404180000}, pkey:{tid:1100611139404002, partition_id:0, part_cnt:0}, uref:1073741824, opid:0|[start_trans] u=19 ret:0, left_time:10000000, uref:1073741825, opid:2|[start_task] u=16 ret:0, sql_no:4294967297, uref:1073741825, trace_id:YB4214909717-00061D5AC5D2F568-0-0, start_time:1721127404181530, snapshot:1721127404085948, opid:3|[end_task] u=384 ret:0, is_rollback:false, uref:1073741825, opid:4|[set_stc] u=20 stc:1721127404182223, opid:5|[calc_checksum_by_commit] u=41 ret:0, checksum:653673249, checksum_log_ts:9223372036854775807, opid:5|[submit_log] u=111 ret:0, log_type:64, logging:1, pending:0, uref:1073741825, opid:5|[sp_commit] u=2 ret:0, is_rollback:false, is_readonly:false, user_action:0, uref:1073741825, opid:5|[update_trans_version] u=2514 trans_version:1721127404182263, uref:1073741825, opid:7|[exiting] u=25 uref:1073741825, arg1:1, arg2:1, opid:7|[on_sync_log_succ] u=7 ret:0, log_type:64, log_id:1428844, logging:0, pending:0, uref:1, opid:7|[end_trans_cb] u=19 ret:0, param:0, param:true, opid:8|[destroy] u=6 arg1:140637654992848, opid:8|total_timeu=3164)
[2024-07-16 18:56:47.289765] TRACE [TRACE]obmp_base.cpp:152 [112950][0][YB4214909717-00061D5AC8029E69-0-0] [lt=72] [dc=0] [err query](TRACE=begin_ts=1721127407289724 2024-07-16 10:56:47.289724|[start_sql] u=0 addr:{ip:“127.0.0.1”, port:48860}|[process_begin] u=1 addr:{ip:“127.0.0.1”, port:48860}, in_queue_time:37, receive_ts:1721127407289686, enqueue_ts:1721127407289689, trace_id:YB4214909717-00061D5AC8029E69-0-0|[process_end] u=18 run_ts:1721127407289740|[process_ret] u=0 process_ret:-4009|total_timeu=19)
[2024-07-16 18:56:47.951347] TRACE [TRACE]obmp_base.cpp:152 [112952][0][YB4214909717-00061D5AC7E2A089-0-0] [lt=32] [dc=0] [err query](TRACE=begin_ts=1721127407951278 2024-07-16 10:56:47.951278|[start_sql] u=0 addr:{ip:“127.0.0.1”, port:48964}|[process_begin] u=1 addr:{ip:“127.0.0.1”, port:48964}, in_queue_time:47, receive_ts:1721127407951230, enqueue_ts:1721127407951234, trace_id:YB4214909717-00061D5AC7E2A089-0-0|[process_end] u=15 run_ts:1721127407951287|[process_ret] u=0 process_ret:-4009|total_timeu=16)
[2024-07-16 18:56:48.130856] TRACE [TRACE]obmp_base.cpp:152 [112946][0][YB4214909717-00061D5AC8429DA6-0-0] [lt=26] [dc=0] [err query](TRACE=begin_ts=1721127408130810 2024-07-16 10:56:48.130810|[start_sql] u=0 addr:{ip:“127.0.0.1”, port:48998}|[process_begin] u=1 addr:{ip:“127.0.0.1”, port:48998}, in_queue_time:22, receive_ts:1721127408130787, enqueue_ts:1721127408130788, trace_id:YB4214909717-00061D5AC8429DA6-0-0|[process_end] u=7 run_ts:1721127408130815|[process_ret] u=1 process_ret:-4009|total_timeu=9)
[2024-07-16 18:56:48.141394] TRACE [TRACE]obmp_base.cpp:152 [112956][0][YB4214909717-00061D5AC8A29B19-0-0] [lt=26] [dc=0] [err query](TRACE=begin_ts=1721127408141364 2024-07-16 10:56:48.141364|[start_sql] u=0 addr:{ip:“127.0.0.1”, port:48872}|[process_begin] u=1 addr:{ip:“127.0.0.1”, port:48872}, in_queue_time:17, receive_ts:1721127408141346, enqueue_ts:1721127408141348, trace_id:YB4214909717-00061D5AC8A29B19-0-0|[process_end] u=7 run_ts:1721127408141369|[process_ret] u=0 process_ret:-4009|total_timeu=8)
[2024-07-16 18:56:48.147577] TRACE [TRACE]obmp_base.cpp:152 [112948][0][YB4214909717-00061D5AC8229DDA-0-0] [lt=33] [dc=0] [err query](TRACE=begin_ts=1721127408147549 2024-07-16 10:56:48.147549|[start_sql] u=0 addr:{ip:“127.0.0.1”, port:48992}|[process_begin] u=1 addr:{ip:“127.0.0.1”, port:48992}, in_queue_time:26, receive_ts:1721127408147522, enqueue_ts:1721127408147524, trace_id:YB4214909717-00061D5AC8229DDA-0-0|[process_end] u=7 run_ts:1721127408147554|[process_ret] u=0 process_ret:-4009|total_timeu=8)
[2024-07-16 18:56:56.228843] TRACE [TRACE]ob_trans_ctx.cpp:504 [112973][0][Y0-0000000000000000-0-0] [lt=38] [dc=0] [trans sampling] (TRACE=begin_ts=1721127416225359 2024-07-16 10:56:56.225359|[init] u=0 arg1:140637654991440, ctx_type:“participant”, trans_type:0, trans_id:{hash:2904063602572109326, inc:65822, addr:{ip:“20.144.151.23”, port:2882}, t:1721127416225000}, pkey:{tid:1100611139404002, partition_id:0, part_cnt:0}, uref:1073741824, opid:0|[start_trans] u=20 ret:0, left_time:10000000, uref:1073741825, opid:2|[start_task] u=13 ret:0, sql_no:4294967297, uref:1073741825, trace_id:YB4214909717-00061D5AC5D2F5F0-0-0, start_time:1721127416225114, snapshot:1721127416219130, opid:3|[end_task] u=447 ret:0, is_rollback:false, uref:1073741825, opid:4|[set_stc] u=23 stc:1721127416225857, opid:5|[calc_checksum_by_commit] u=42 ret:0, checksum:357159525, checksum_log_ts:9223372036854775807, opid:5|[submit_log] u=130 ret:0, log_type:64, logging:1, pending:0, uref:1073741825, opid:5|[sp_commit] u=3 ret:0, is_rollback:false, is_readonly:false, user_action:0, uref:1073741825, opid:5|[update_trans_version] u=2571 trans_version:1721127416225899, uref:1073741825, opid:7|[exiting] u=30 uref:1073741825, arg1:1, arg2:1, opid:7|[on_sync_log_succ] u=7 ret:0, log_type:64, log_id:1428980, logging:0, pending:0, uref:1, opid:7|[end_trans_cb] u=26 ret:0, param:0, param:true, opid:8|[destroy] u=7 arg1:140637654992848, opid:8|total_timeu=3319)
[2024-07-16 18:57:17.300379] TRACE [TRACE]obmp_base.cpp:152 [112948][0][YB4214909717-00061D5AC8229DE4-0-0] [lt=17] [dc=0] [err query](TRACE=begin_ts=1721127437300342 2024-07-16 10:57:17.300342|[start_sql] u=0 addr:{ip:“127.0.0.1”, port:49092}|[process_begin] u=1 addr:{ip:“127.0.0.1”, port:49092}, in_queue_time:86, receive_ts:1721127437300255, enqueue_ts:1721127437300257, trace_id:YB4214909717-00061D5AC8229DE4-0-0|[process_end] u=9 run_ts:1721127437300348|[process_ret] u=0 process_ret:-4009|total_timeu=10)