【 使用环境 】生产环境
【 使用版本 】4.4.1
【问题描述】虽然修改了ob_query_timeout但是执行仍然10秒超时
【复现路径】
MySQL [(none)]> show create table hms_catalog_kerberos.dw.dw_t1_h;
ERROR 4012 (HY000): Timeout, query has reached the maximum query timeout: 60000000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again.
这应该是ob内部sql执行超时了。麻烦提供一下
1）设置trace信息
SET ob_enable_show_trace=‘ON’;
2）执行sql。
3）获取上个命令的trace
select last_trace_id();
4）获取trace对应的节点
select query_sql,svr_ip from gv$ob_sql_audit where trace_id=‘第三步获取的trace信息’；
5）取对应的svr_ip节点 过滤日志
grep “第三步获取的trace信息” observer.log*
grep “第三步获取的trace信息” rootservice.log*
6）提供日志信息即可。
observer.log.20251126164854508:[2025-11-26 16:42:17.384076] WDIAG [SHARE] try_get_client_from_queue_unlocked_ (ob_hms_client_pool.cpp:567) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=14][errcode=-4018] no client available in queue(ret=-4018)
observer.log.20251126164854508:[2025-11-26 16:42:17.384138] INFO [SHARE] init (ob_kerberos.cpp:65) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=15] setup env for krb5.conf path(ret=0, config_path="/etc/krb5.conf")
observer.log.20251126164854508:[2025-11-26 16:42:17.384294] INFO [SHARE] init (ob_kerberos.cpp:102) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=13] resolve principal(ret=0)
observer.log.20251126164854508:[2025-11-26 16:42:17.384337] INFO [SHARE] init (ob_kerberos.cpp:169) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=14] using default cache(ret=0, cc_name="/tmp/krb5cc_1003")
observer.log.20251126164854508:[2025-11-26 16:42:17.384353] INFO [SHARE] init (ob_kerberos.cpp:231) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=12] trying to renew credentials(ret=0)
observer.log.20251126164854508:[2025-11-26 16:42:17.386952] WDIAG [SHARE] init (ob_kerberos.cpp:241) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=8][errcode=0] trying to get initial credentials again(ret=0, err_msg="Ticket expired")
observer.log.20251126164854508:[2025-11-26 16:42:17.389325] WDIAG [SHARE] setup_hive_metastore_client (ob_hive_metastore.cpp:472) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=60][errcode=-11105] service should not be empty(ret=-11105, temp_princ=HADOOP.COM, service=)
observer.log.20251126164854508:[2025-11-26 16:42:17.389358] WDIAG [SHARE] create_new_client_unlocked_ (ob_hms_client_pool.cpp:484) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=29][errcode=-11105] failed to create hive thrift client(ret=-11105)
observer.log.20251126164854508:[2025-11-26 16:42:17.389446] WDIAG [SHARE] ~ObHiveMetastoreClient (ob_hive_metastore.cpp:637) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=81][errcode=-4016] hive metastore client is invalid in destructor(ret=-4016)
observer.log.20251126164854508:[2025-11-26 16:42:17.389513] WDIAG [SHARE] try_create_and_get_client_unlocked_ (ob_hms_client_pool.cpp:582) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=61][errcode=-11105] failed to create new client(ret=-11105)
observer.log.20251126164854508:[2025-11-26 16:42:17.389555] WDIAG [SHARE] get_client (ob_hms_client_pool.cpp:243) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=43][errcode=0] failed to get or create client(ret=0, tmp_ret=-11105)
observer.log.20251126164854508:[2025-11-26 16:42:42.090089] INFO [RPC.OBMYSQL] print_session_info (ob_sql_nio.cpp:1171) [1622196][sql_nio17][T0][Y0-0000000000000000-0-0] [lt=18] [sql nio session](*s={this:0x7f9f23a09030, session_id:3227490939, trace_id:YB420A976693-000644683B5C5C7C-0-0, sql_handling_stage:11, sql_initiative_shutdown:false, reader:{fd:2335}, err:0, last_decode_time:1764146537381491, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:804, pending_flag:1, may_handling_flag:true, handler_close_flag:false})
.......
observer.log.20251126170156549:[2025-11-26 16:52:05.591748] INFO [RPC.OBMYSQL] print_session_info (ob_sql_nio.cpp:1171) [1622196][sql_nio17][T0][Y0-0000000000000000-0-0] [lt=18] [sql nio session](*s={this:0x7f9f23a09030, session_id:3227490939, trace_id:YB420A976693-000644683B5C5C7C-0-0, sql_handling_stage:11, sql_initiative_shutdown:false, reader:{fd:2335}, err:0, last_decode_time:1764146537381491, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:804, pending_flag:1, may_handling_flag:true, handler_close_flag:false})
observer.log.20251126170156549:[2025-11-26 16:52:17.384200] WDIAG [SHARE] get_client (ob_hms_client_pool.cpp:265) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=13][errcode=-4012] fail to exec pool_cond_.wait_us(remaining_time)(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384238] WDIAG [SHARE] get_client (ob_hms_client_pool.cpp:709) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=38][errcode=-4012] failed to get client from pool(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384246] WDIAG [SHARE] do_init (ob_hms_catalog.cpp:59) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=8][errcode=-4012] failed to get client from pool(ret=-4012, catalog_id=500010, uri=thrift://hdpmaster1:9083)
observer.log.20251126170156549:[2025-11-26 16:52:17.384340] WDIAG [SHARE] init (ob_external_catalog.cpp:42) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=96][errcode=-4012] failed to init properties(ret=-4012, properties={"TYPE":"HMS", "URI":"7468726966743A2F2F686C6A796469646970316D6173746572313A39303833", "PRINCIPAL":"746D6E404841444F4F502E434F4D", "KEYTAB":"2F686F6D652F6F6365616E626173652F2E746D6E2E6B6579746162", "KRB5CONF":"2F6574632F6B7262352E636F6E66", "MAX_CLIENT_POOL_SIZE":20, "SOCKET_TIMEOUT":600000000, "CACHE_REFRESH_INTERVAL_SEC":-1, "DEFAULT_CATALOG":""})
observer.log.20251126170156549:[2025-11-26 16:52:17.384350] WDIAG [SHARE] get_catalog_ (ob_catalog_meta_getter.cpp:330) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=10][errcode=-4012] failed to init hive catalog(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384360] WDIAG [SHARE] list_namespace_names (ob_catalog_meta_getter.cpp:43) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=9][errcode=-4012] failed to get catalog(ret=-4012, tenant_id=1002, catalog_id=500010)
observer.log.20251126170156549:[2025-11-26 16:52:17.384368] WDIAG [SERVER] fill_scanner (ob_tenant_show_catalog_databases.cpp:128) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=7][errcode=-4012] list_namespace_names failed(ret=-4012, tenant_id_=1002, catalog_id_=500010)
observer.log.20251126170156549:[2025-11-26 16:52:17.384379] WDIAG [SERVER] inner_get_next_row (ob_tenant_show_catalog_databases.cpp:100) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=11][errcode=-4012] fail to fill scanner(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384388] WDIAG [COMMON] get_next_row (ob_virtual_table_iterator.cpp:377) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=7][errcode=-4012] fail to inner get next row(ret=-4012, scan_param_={tablet_id:{id:1}, ls_id:{id:1}, column_ids:[16, 17], index_id:12527, key_ranges:[{"range":"table_id:12527,group_idx:0,index_ordered_idx:0,({"BIGINT":500010},MIN;{"BIGINT":500010},MAX)"}], ss_key_ranges:[{"range":"table_id:12527,group_idx:0,index_ordered_idx:0,(MIN;MAX)"}], range_array_pos:[], timeout:1764206537282028, scan_flag:{scan_order:1, daily_merge:0, rmmb_optimize:0, whole_macro_scan:0, full_row:0, index_back:0, query_stat:0, sql_mode:0, read_latest:0, prewarm:0, join_type:0, use_row_cache:0, use_block_index_cache:0, use_bloomfilter_cache:0, multi_version_minor_merge:0, is_need_feedback:1, use_fuse_row_cache:0, use_fast_agg:0, iter_uncommitted_row:0, ignore_trans_stat:0, is_large_query:0, is_sstable_cut:0, skip_read_lob:0, is_lookup_for_4377:0, is_bare_row_scan:0, enable_rich_format:0, is_for_foreign_key_check:0, is_mds_query:0, is_select_follower:0, enable_lob_prefetch:0, is_bare_row_scan:0, mr_mv_scan:0, is_plain_insert_gts_opt:0, reserved:0}, sql_mode:281018368, reserved_cell_count:2, schema_version:1061912, query_begin_schema_version:1764146119924280, limit_offset:{offset_:0, limit_:-1}, for_update:false, wait:-1, frozen_version:-1, is_get:false, output_exprs:[{type:"T_REF_COLUMN", datum_meta:{type:"BIGINT", cs_type:"binary", scale:0, precision:20}, obj_meta:{type:"BIGINT", collation:"binary", coercibility:"NUMERIC"}, obj_datum_map:3, flag:67, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:3, frame_idx:1, datum_off:20, res_buf_off:701, dyn_buf_header_offset:573, res_buf_len:8, eval_flags_off:525, pvt_skip_off:32, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:181, eval_vector_func:null, local_session_var_id:-1, this:0x7f9c0a4dc148}, {type:"T_REF_COLUMN", datum_meta:{type:"VARCHAR", cs_type:"utf8mb4_general_ci", scale:-1, precision:-1}, obj_meta:{type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"IMPLICIT"}, obj_datum_map:1, flag:3, eval_func:null, eval_batch_func:null, inner_functions:null, inner_func_cnt:0, arg_cnt:0, parent_cnt:0, frame_idx:1, datum_off:0, res_buf_off:573, dyn_buf_header_offset:557, res_buf_len:128, eval_flags_off:517, pvt_skip_off:12, expr_ctx_id:4294967295, extra:0, batch_idx_mask:18446744073709551615, vector_header_off:116, eval_vector_func:null, local_session_var_id:-1, this:0x7f9c0a4dc060}], op_filters:NULL, trans_desc:NULL, snapshot:{this:0x7f9c0a2c87a0, valid:false, source:0, core:{version:{val:18446744073709551615, v:3}, tx_id:{txid:0}, scn:0}, uncertain_bound:0, snapshot_lsid:{id:-1}, snapshot_ls_role:0, snapshot_acquire_addr:"0.0.0.0:0", parts:[], committed:false}, table_param:{table_id:12527, output_projector:[0, 1], aggregate_projector:[], group_by_projector:[], output_sel_mask:[true, true], pad_col_projector:[], read_param_version:1, main_read_info:{schema_column_count:2, schema_rowkey_cnt:2, rowkey_cnt:4, trans_col_index:-1, mview_old_new_col_index:-1, group_idx_col_index:-1, seq_read_column_count:2, max_col_index:1, is_oracle_mode:false, cols_index:{rowkey_mode:false, for_memtable:false, array:{ObIArray:[cnt:2, 0, 1], data:0x7f9c0a4e00e0, count:2, allocator:0x7f9c0a4aefb0, capacity:2, init_cnt:2}}, memtable_cols_index:{rowkey_mode:false, for_memtable:true, array:{ObIArray:[cnt:2, 0, 1], data:0x7f9c0a4e00f0, count:2, allocator:0x7f9c0a4aefb0, capacity:2, init_cnt:2}}, cols_desc:{ObIArray:[cnt:2, column_id=16 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0], data:0x7f9c0a4e00c0, count:2, allocator:0x7f9c0a4aefb0, capacity:2, init_cnt:2}, cg_idxs:{ObIArray:[cnt:0], data:null, count:0, allocator:null, capacity:0, init_cnt:0}, cols_extend:{ObIArray:[cnt:2, {pack:0, min_max:0, sum:0, loose_min_max:0, bm25_token_freq_param:0, bm25_doc_len_param:0}, {pack:0, min_max:0, sum:0, loose_min_max:0, bm25_token_freq_param:0, bm25_doc_len_param:0}], data:0x7f9c0a4e0120, count:2, allocator:0x7f9c0a4aefb0, capacity:2, init_cnt:2}, has_all_column_group:true, need_truncate_filter:false, micro_block_format_version:1}, use_lob_locator:false, rowid_version:0, rowid_projector:[], enable_lob_locator_v2:true, is_fts_index:false, parser_name:"", parser_properties:"", is_vec_index:false, is_column_replica_table:false, is_normal_cgs_at_the_end:false, is_mlog_table:false, is_enable_semistruct_encoding:false, is_safe_filter_with_di:true, aggregate_param_props:[], access_virtual_col_cnt:0, plan_enable_rich_format:true}, sample_info:{method:0, percent:"1.000000000000000000e+02", seed:-1, table_id:0, scope:0, force_block:false}, need_scn:false, need_switch_param:false, is_mds_query:false, fb_read_tx_uncommitted:false, external_file_format:{"TYPE":"INVALID"}, external_file_location:"", tx_seq_base:1764146492086614, auto_split_filter_type:18446744073709551615, is_tablet_spliting:false, need_update_tablet_param:true, mds_collector:NULL})
observer.log.20251126170156549:[2025-11-26 16:52:17.384658] WDIAG [COMMON] get_next_row (ob_virtual_table_iterator.cpp:499) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=279][errcode=-4012] get next row failed(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384666] WDIAG [SQL.DAS] inner_get_next_row (ob_das_scan_iter.cpp:121) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=7][errcode=-4012] failed to get next row(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384673] WDIAG [SQL.DAS] get_next_seq_row (ob_das_merge_iter.cpp:889) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=6][errcode=-4012] das iter failed to get next row(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384682] WDIAG [SQL.DAS] inner_get_next_row (ob_das_merge_iter.cpp:402) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=9][errcode=-4012] das iter failed to get next row(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384692] WDIAG [SQL.ENG] get_next_row_with_das (ob_table_scan_op.cpp:2536) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=8][errcode=-4012] get next row from das result failed(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384702] WDIAG [SQL.ENG] inner_get_next_row_for_tsc (ob_table_scan_op.cpp:2701) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=9][errcode=-4012] fail to get next row from ObNewRowIterator(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384711] WDIAG [SQL.ENG] inner_get_next_row_implement (ob_table_scan_op.cpp:2679) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=8][errcode=-4012] failed to get next row(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384717] WDIAG [SQL.ENG] inner_get_next_row (ob_table_scan_op.cpp:3792) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=6][errcode=-4012] get next row failed(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384728] WDIAG [SQL.ENG] get_next_row (ob_operator.cpp:1331) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=8][errcode=-4012] inner get next row failed(ret=-4012, type=3, op="PHY_TABLE_SCAN", op_id=1)
observer.log.20251126170156549:[2025-11-26 16:52:17.384741] WDIAG [SQL.ENG] get_next_batch_with_onlyone_row (ob_operator.h:629) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=12][errcode=-4012] Failed to get_next_row(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384758] WDIAG [SQL.ENG] process_sort_batch (ob_sort_op.cpp:279) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=16][errcode=-4012] get next batch failed(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384769] WDIAG [SQL.ENG] inner_get_next_batch (ob_sort_op.cpp:576) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=9][errcode=-4012] process sort failed(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384777] WDIAG [SQL.ENG] get_next_batch (ob_operator.cpp:1509) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=8][errcode=-4012] get next batch failed(ret=-4012, eval_ctx={batch_idx:0, batch_size:1, max_batch_size:1, frames_:0x7f9c0a2c3320}, id=0, op_name="PHY_SORT")
observer.log.20251126170156549:[2025-11-26 16:52:17.384789] WDIAG [SQL.ENG] get_next_row (ob_operator.cpp:2098) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=13][errcode=-4012] get next batch failed(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384796] WDIAG [SQL] inner_get_next_row (ob_result_set.cpp:478) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=5][errcode=-4012] get next row from exec result failed(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384807] WDIAG [SERVER] response_query_result (ob_query_driver.cpp:328) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=9][errcode=-4012] fail to iterate and response(ret=-4012, row_num=0, can_retry=true)
observer.log.20251126170156549:[2025-11-26 16:52:17.384842] WDIAG [SERVER] response_result (ob_sync_plan_driver.cpp:93) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=11][errcode=-4012] response query result fail(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.384861] WDIAG [SERVER] after_func (ob_query_retry_ctrl.cpp:1078) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=12][errcode=-4012] [RETRY] check if need retry(v={force_local_retry:false, stmt_retry_times:0, local_retry_times:0, err_:-4012, err_:"OB_TIMEOUT", retry_type:0, client_ret:-4012, is_interrupted_by_outer_query:false}, need_retry=false)
observer.log.20251126170156549:[2025-11-26 16:52:17.384878] WDIAG [SERVER] response_result (ob_sync_plan_driver.cpp:105) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=17][errcode=-4012] result response failed, check if need retry(ret=-4012, cli_ret=-4012, retry_ctrl_.need_retry()=0)
observer.log.20251126170156549:[2025-11-26 16:52:17.385003] WDIAG [SHARE.SCHEMA] revert (ob_schema_mgr_cache.cpp:119) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=8][errcode=0] long time to hold one guard(schema_mgr=0x7f9de3dc0500, tenant_id=1002, version=1764146119924280, cur_timestamp=1764147137384899, ref_timestamp=1764146537383600, lbt()="0x91dffd8 0x1bb086b9 0x8e699d7 0x8e6990f 0x8e33e5a 0x8d68009 0x8d64595 0x8d63203 0x8d63508 0x8d60484 0x8cbe720 0x8c75b1a 0x8c6b063 0x8c646ec 0x8c5533e 0x1151d632 0x22634d89 0x7f9fe6618f1b 0x7f9fe654e33f")
observer.log.20251126170156549:[2025-11-26 16:52:17.385130] WDIAG [SERVER] response_result (ob_sync_plan_driver.cpp:115) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=9][errcode=-4012] close result set fail(cret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.385142] WDIAG response_result (ob_sync_plan_driver.cpp:246) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=8][errcode=-4012] Timeout, query has reached the maximum query timeout: 60000000000(us), maybe you can adjust the session variable ob_query_timeout or query_timeout hint, and try again.
observer.log.20251126170156549:[2025-11-26 16:52:17.385198] INFO [SERVER] send_error_packet (obmp_packet_sender.cpp:381) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=11] sending error packet(ob_error=-4012, client error=-4012, extra_err_info=NULL, lbt()="0x91dffd8 0x11395db8 0x1134dcbb 0x8cbe99f 0x8c75b1a 0x8c6b063 0x8c646ec 0x8c5533e 0x1151d632 0x22634d89 0x7f9fe6618f1b 0x7f9fe654e33f")
observer.log.20251126170156549:[2025-11-26 16:52:17.385247] INFO [SERVER] send_error_packet (obmp_packet_sender.cpp:584) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=15] dump txn free route audit_record(value=1048581, session->get_server_sid()=3227490939, session->get_proxy_sessid()=763191563856838763)
observer.log.20251126170156549:[2025-11-26 16:52:17.385273] WDIAG [SERVER] do_process (obmp_query.cpp:1155) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=9][errcode=-4012] execute query fail(ret=-4012, timeout_timestamp=1764206537382028)
observer.log.20251126170156549:[2025-11-26 16:52:17.385353] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:139) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=8][errcode=0] set logical del time(cache_obj->get_logical_del_time()=36738662160876, cache_obj->added_lc()=false, cache_obj->get_object_id()=2903, cache_obj->get_tenant_id()=1002, lbt()="0x91dffd8 0x16e209e6 0x8c8ce9a 0x8c76c63 0x8c6b063 0x8c646ec 0x8c5533e 0x1151d632 0x22634d89 0x7f9fe6618f1b 0x7f9fe654e33f")
observer.log.20251126170156549:[2025-11-26 16:52:17.385443] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:82) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=10][errcode=-4012] process request fail(ret=-4012)
observer.log.20251126170156549:[2025-11-26 16:52:17.385456] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:163) [1878821][T1002_L0_G0][T1002][YB420A976693-000644683B5C5C7C-0-0] [lt=12][errcode=-4012] process request fail(ret=-4012)
新建一个hive connector的catalog, 需要提供hms的地址等等。 CREATE CATALOG hive _catalog using hive WITH ( “hive .metastore .uri” = ‘thrift://example.net:9083’, “fs.x.enabled” = ‘true’ );
hadoop那边开启了kerberos认证，是不是得是这种写法：
CREATE EXTERNAL CATALOG hms_catalog_kerberos
PROPERTIES = (
TYPE = 'HMS',
URI = "thrift://master1:9083",
PRINCIPAL = "test@HADOOP.COM",
KEYTAB = "/home/oceanbase/test.keytab",
KRB5CONF = "/etc/krb5.conf"
);
hive那边开启kerberos认证了。另外，4.4.1的文档中貌似不是这么建的。
学习总结经验 
数据格式是 time_key (2025–1-1- 27:00:00 ) → bigint
很显然 ob 继承了 hive上元数据schema，预期把这个数据转为 bigint，是失败了的。
符合预期，ob 对类型是强校验的，主要是为了防止数据类型转换问题，当前看 hive 默认转换失败的都是会变为 null，而 ob 则会提示报错
